2026-03-28 11:00:09 [scrapy.utils.log] INFO: Scrapy 2.11.2 started (bot: SourcingV2)
2026-03-28 11:00:09 [scrapy.utils.log] INFO: Versions: lxml 5.2.2.0, libxml2 2.12.6, cssselect 1.2.0, parsel 1.9.1, w3lib 2.1.2, Twisted 24.3.0, Python 3.11.2 (main, Mar 13 2023, 12:18:29) [GCC 12.2.0], pyOpenSSL 24.1.0 (OpenSSL 3.2.1 30 Jan 2024), cryptography 42.0.7, Platform Linux-5.15.0-1098-azure-x86_64-with-glibc2.36
2026-03-28 11:00:09 [bca.uk] INFO: Starting spider bca.uk
2026-03-28 11:00:09 [azure.identity._credentials.environment] INFO: Incomplete environment configuration for EnvironmentCredential. These variables are set: AZURE_CLIENT_ID, AZURE_TENANT_ID
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2114
2026-03-28 11:00:09 [azure.identity._credentials.chained] INFO: DefaultAzureCredential acquired a token from WorkloadIdentityCredential
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxsourcingstorageprod.table.core.windows.net:443
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27cookies%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [bca.uk] INFO: No cached cookies found, will perform fresh login
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /SpiderData()?$filter=PartitionKey%20eq%20%27BCAUk%27%20and%20RowKey%20eq%20%27auth_token%27 HTTP/1.1" 200 None
2026-03-28 11:00:09 [bca.uk] INFO: Loaded cached Auth0 token from Azure Tables (length=1492)
2026-03-28 11:00:09 [scrapy.addons] INFO: Enabled addons:
[]
2026-03-28 11:00:09 [asyncio] DEBUG: Using selector: EpollSelector
2026-03-28 11:00:09 [scrapy.utils.log] DEBUG: Using reactor: twisted.internet.asyncioreactor.AsyncioSelectorReactor
2026-03-28 11:00:09 [scrapy.utils.log] DEBUG: Using asyncio event loop: asyncio.unix_events._UnixSelectorEventLoop
2026-03-28 11:00:10 [scrapy.extensions.telnet] INFO: Telnet Password: 68ffe77f09517cdf
2026-03-28 11:00:10 [scrapy.middleware] INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
'scrapy.extensions.telnet.TelnetConsole',
'scrapy.extensions.memusage.MemoryUsage',
'scrapy.extensions.feedexport.FeedExporter',
'scrapy.extensions.logstats.LogStats',
'scrapy.extensions.closespider.CloseSpider']
2026-03-28 11:00:10 [scrapy.crawler] INFO: Overridden settings:
{'BOT_NAME': 'SourcingV2',
'CLOSESPIDER_TIMEOUT': 7200,
'DOWNLOAD_MAXSIZE': 52428800,
'DOWNLOAD_WARNSIZE': 10485760,
'FEED_EXPORT_ENCODING': 'utf-8',
'LOG_FILE': '/var/log/scrapyd/logs/sourcing_v2/bca.uk/task_51_2026-03-28T11_00_00.log',
'LOG_FORMATTER': 'crawlers.log_formatter.SourcingLogFormatter',
'MEMUSAGE_LIMIT_MB': 2048,
'MEMUSAGE_WARNING_MB': 1536,
'NEWSPIDER_MODULE': 'spiders',
'REQUEST_FINGERPRINTER_CLASS': 'scrapy_zyte_api.ScrapyZyteAPIRequestFingerprinter',
'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
'SPIDER_MODULES': ['spiders', 'auth_check'],
'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
'USER_AGENT': ''}
2026-03-28 11:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:00:10 [scrapy_zyte_api.handler] INFO: Using a Zyte API key starting with '5857011'
2026-03-28 11:00:10 [scrapy.middleware] INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
'scrapy_zyte_api.ScrapyZyteAPIDownloaderMiddleware',
'scrapy.downloadermiddlewares.retry.RetryMiddleware',
'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
'scrapy.downloadermiddlewares.stats.DownloaderStats']
2026-03-28 11:00:10 [crawlers.middlewares.id_gen_middleware] INFO: Setting up IdGenerationMiddleware
2026-03-28 11:00:10 [scrapy.middleware] INFO: Enabled spider middlewares:
['scrapy.spidermiddlewares.httperror.HttpErrorMiddleware',
'scrapy_zyte_api.ScrapyZyteAPISpiderMiddleware',
'crawlers.middlewares.monitoring_spider_middleware.MonitoringSpiderMiddleware',
'scrapy.spidermiddlewares.referer.RefererMiddleware',
'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
'scrapy.spidermiddlewares.depth.DepthMiddleware',
'crawlers.middlewares.photo_download_middleware.PhotoDownloadMiddleware',
'crawlers.middlewares.report_download_middleware.ReportDownloadMiddleware',
'crawlers.middlewares.id_gen_middleware.IdGenMiddleware']
2026-03-28 11:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:00:10 [crawlers.pipelines.translation_pipeline] INFO: Loading translations for language: auto
2026-03-28 11:00:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /Translations()?$filter=PartitionKey%20eq%20%27auto%27%20and%20RowKey%20eq%20%27auto%27 HTTP/1.1" 200 None
2026-03-28 11:00:10 [crawlers.pipelines.item_rules_pipeline] INFO: Setting up ItemRules Pipeline
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_location_for_country.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_cars_from_auction_title.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_country.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_fr.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_photos.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: damaged_from_info.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_not_allowed.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: not_operable_from_info.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: makes_models_not_allowed.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_title.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: imported_cars.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_currency.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_mileage.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: keywords_from_auction_title.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: invalid_country_of_origin.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: puretech_for_pt.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: electric_cars.json
2026-03-28 11:00:10 [crawlers.filter_rules.rules_loader] INFO: Loaded rule: missing_color.json
2026-03-28 11:00:10 [crawlers.pipelines.post_to_api] INFO: Setting up PostToApi Pipeline pointing to https://api.app.infinit.cc/api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing
2026-03-28 11:00:10 [scrapy.middleware] INFO: Enabled item pipelines:
['crawlers.pipelines.translation_pipeline.TranslationPipeline',
'crawlers.pipelines.item_rules_pipeline.ItemRulesPipeline',
'crawlers.pipelines.post_to_api.PostToApiPipeline']
2026-03-28 11:00:10 [scrapy.core.engine] INFO: Spider opened
2026-03-28 11:00:10 [scrapy.extensions.logstats] INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 11:00:10 [scrapy.extensions.telnet] INFO: Telnet console listening on 127.0.0.1:6024
2026-03-28 11:00:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 141MiB
2026-03-28 11:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:00:10 [scrapy-playwright] INFO: Starting download handler
2026-03-28 11:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-28 11:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-28 11:00:10 [scrapy-playwright] INFO: Launching 1 startup context(s)
2026-03-28 11:00:10 [scrapy-playwright] INFO: Launching browser chromium
2026-03-28 11:00:11 [scrapy-playwright] INFO: Browser chromium launched
2026-03-28 11:00:11 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-28 11:00:12 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-28 11:00:12 [scrapy-playwright] INFO: Browser chromium launched
2026-03-28 11:00:12 [scrapy-playwright] DEBUG: Browser context started: 'default' (persistent=False, remote=False)
2026-03-28 11:00:12 [scrapy-playwright] INFO: Startup context(s) launched
2026-03-28 11:00:15 [bca.uk] INFO: No cached cookies available, starting login process with credentials
2026-03-28 11:00:15 [bca.uk] INFO: Zyte login attempt 1/3
2026-03-28 11:00:15 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/> (referer: None) ['zyte-api']
2026-03-28 11:01:01 [bca.uk] INFO: Action 0 (waitForTimeout): status=success, elapsed=4.999s
2026-03-28 11:01:01 [bca.uk] INFO: Action 1 (waitForSelector): status=success, elapsed=0.008s
2026-03-28 11:01:01 [bca.uk] INFO: Action 2 (evaluate): status=success, elapsed=0.002s
2026-03-28 11:01:01 [bca.uk] INFO: Action 3 (waitForTimeout): status=success, elapsed=1.001s
2026-03-28 11:01:01 [bca.uk] INFO: Action 4 (click): status=success, elapsed=2.147s
2026-03-28 11:01:01 [bca.uk] INFO: Action 5 (waitForSelector): status=success, elapsed=0.866s
2026-03-28 11:01:01 [bca.uk] INFO: Action 6 (waitForTimeout): status=success, elapsed=1s
2026-03-28 11:01:01 [bca.uk] INFO: Action 7 (click): status=success, elapsed=2.064s
2026-03-28 11:01:01 [bca.uk] INFO: Action 8 (type): status=success, elapsed=0.031s
2026-03-28 11:01:01 [bca.uk] INFO: Action 9 (waitForTimeout): status=success, elapsed=1.001s
2026-03-28 11:01:01 [bca.uk] INFO: Action 10 (click): status=success, elapsed=1.434s
2026-03-28 11:01:01 [bca.uk] INFO: Action 11 (type): status=success, elapsed=0.035s
2026-03-28 11:01:01 [bca.uk] INFO: Action 12 (waitForTimeout): status=success, elapsed=1.001s
2026-03-28 11:01:01 [bca.uk] INFO: Action 13 (click): status=success, elapsed=0.57s
2026-03-28 11:01:01 [bca.uk] INFO: Action 14 (waitForSelector): status=success, elapsed=3.168s
2026-03-28 11:01:01 [bca.uk] INFO: Action 15 (evaluate): status=success, elapsed=0.002s
2026-03-28 11:01:01 [bca.uk] INFO: Action 16 (waitForTimeout): status=success, elapsed=10.001s
2026-03-28 11:01:01 [bca.uk] INFO: Action 17 (evaluate): status=success, elapsed=0.001s
2026-03-28 11:01:01 [bca.uk] INFO: Page URL after login: https://www.bca.co.uk/
2026-03-28 11:01:01 [bca.uk] INFO: Successfully logged in via Zyte API session
2026-03-28 11:01:01 [bca.uk] INFO: Scrapy-formatted cookies: [{'name': 's_cc', 'value': 'true', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtSa', 'value': '-', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dest', 'value': 'https://www.bca.co.uk/', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_getNewRepeat', 'value': '1774695650128-New', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'csrf', 'value': 'iZGrTcRZp_5wgkSQkM-SpI14KZo3bByNMPNqXWNFlEymmvU7jyltsoylFB3JqqPwSUkycX09TwdZJo704BRPRw:AAABnTQaOq0:ysRaDFJp3MRtgfTFIsmvsA', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': '__cf_bm', 'value': 'u8OXdGvaFQGF69LHH3.3jOotisGQgJAA8sdzE02g1Kg-1774695627.0575116-1.0.1.1-6Shs99nQP.A5ID6zbnBzpLgThysJHhuBNxxyVdmiIH9u9W6MJoxXhEbgWrtKAkleO8pbZ2.S50ZJ29lTivYII0BEzhYSSGanrDW3D_yBo258Wa8z4x069Xomox9vPqJmY3edRBreJHT1QMMCLtISgA', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'rxVisitor', 'value': '17746956284732GEBP0NLKFOTDVRN5VK4AAOKNIBM1O1T', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'OptanonAlertBoxClosed', 'value': '2026-03-28T11:00:35.978Z', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCVS_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '1', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'AMCV_E5F2C8A15481C0E20A4C98BC%40AdobeOrg', 'value': '179643557%7CMCIDTS%7C20541%7CMCMID%7C31248044396950919464529269733903301158%7CMCAAMLH-1775300440%7C9%7CMCAAMB-1775300440%7C6G1ynYcLPuiQxYZrsz_pkqfLG9yMXBpb2zX5dvJdYQJzPXImdj0y%7CMCOPTOUT-1774702840s%7CNONE%7CMCSYNCSOP%7C411-20548%7CvVersion%7C5.5.0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'JSESSIONID', 'value': '59A0692E87B1651543F622558F402863', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv_s', 'value': 'First%20Visit', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtPC', 'value': '1$495648781_886h-vPHWROJCCWTCWUOCAFBPRFRFKNBKDAWWA-0e0', 'domain': '.bca.co.uk', 'path': '/'}, {'name': '_legacy_auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'gpv_pn', 'value': 'auctionview', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'ASLBSA', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'INGRESSCOOKIE', 'value': '201d4d7cdb35b651709a73d47c4eaea6|17148814d3d29f21517da122aae4be83', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'OptanonConsent', 'value': 'isGpcEnabled=0&datestamp=Sat+Mar+28+2026+07%3A00%3A48+GMT-0400+(Eastern+Daylight+Time)&version=202510.1.0&browserGpcFlag=0&isIABGlobal=false&hosts=&consentId=44bdbab4-6273-48a1-a049-9d060b3ff3af&interactionCount=1&isAnonUser=1&landingPath=NotLandingPage&groups=C0001%3A1%2CC0003%3A1%2CC0004%3A1%2CC0002%3A1&intType=1&geolocation=US%3BCA&AwaitingReconsent=false', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'sc_dslv', 'value': '1774695650127', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'auth0.VS7z7E8b9vqJ2LYaGXEbb1f5CP1SGRLD.is.authenticated', 'value': 'true', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'ASLBSACORS', 'value': '000323392f7a18bd2b0ff7209c28bb25c0f06dee33a9cf62b65238d7d6868fdf5ddf', 'domain': 'www.bca.co.uk', 'path': '/'}, {'name': 'rxvt', 'value': '1774697450005|1774695628474', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 's_sq', 'value': '%5B%5BB%5D%5D', 'domain': '.bca.co.uk', 'path': '/'}, {'name': 'dtCookie', 'value': 'v_4_srv_1_sn_00E347DEA3CC45BCA5D3E53586089378_perc_100000_ol_0_mul_1_app-3A5d68a08db18e8bbb_1_app-3Aea7c4b59f27d43eb_1', 'domain': '.bca.co.uk', 'path': '/'}]
2026-03-28 11:01:01 [bca.uk] INFO: Extracted 24 cookies from Zyte login response
2026-03-28 11:01:01 [bca.uk] INFO: Merged 15 browser cookies, total: 24
2026-03-28 11:01:01 [bca.uk] INFO: Auth0 token capture: token=yes, error=client-created
2026-03-28 11:01:01 [bca.uk] INFO: Got Auth0 access token via dynamic SDK (length=1492)
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /SpiderData(PartitionKey='BCAUk',RowKey='auth_token') HTTP/1.1" 204 0
2026-03-28 11:01:01 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded
2026-03-28 11:01:01 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:01:01 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:01 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:01 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:10 [scrapy.extensions.logstats] INFO: Crawled 1 pages (at 1 pages/min), scraped 0 items (at 0 items/min)
2026-03-28 11:01:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 155MiB
2026-03-28 11:01:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:01:11 [bca.uk] INFO: Total items found: 100
2026-03-28 11:01:11 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded
2026-03-28 11:01:11 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:01:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:11 [bca.uk] INFO: Found listing with ID: HK20%20GFE
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK20%2520GFE%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [bca.uk] INFO: Scrape type for HK20%20GFE: 0
2026-03-28 11:01:11 [bca.uk] INFO: Found listing with ID: VF19%20GJU
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF19%2520GJU%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [bca.uk] INFO: Scrape type for VF19%20GJU: 0
2026-03-28 11:01:11 [bca.uk] INFO: Found listing with ID: BV15%20PDK
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV15%2520PDK%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [bca.uk] INFO: Scrape type for BV15%20PDK: 0
2026-03-28 11:01:11 [bca.uk] INFO: Found listing with ID: BW15%20VJX
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520VJX%27 HTTP/1.1" 200 None
2026-03-28 11:01:11 [bca.uk] INFO: Scrape type for BW15%20VJX: 2
2026-03-28 11:01:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 354bcfee-b8c8-5f58-8440-841270e7b99d with identifier: BW15%20VJX
2026-03-28 11:01:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 354bcfee-b8c8-5f58-8440-841270e7b99d with scrape type 2
2026-03-28 11:01:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 354bcfee-b8c8-5f58-8440-841270e7b99d with scrape type 2
2026-03-28 11:01:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 354bcfee-b8c8-5f58-8440-841270e7b99d, identifier: BW15%20VJX
2026-03-28 11:01:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:11 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 354bcfee-b8c8-5f58-8440-841270e7b99d with identifier: BW15%20VJX
2026-03-28 11:01:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=black HTTP/1.1" 200 None
2026-03-28 11:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel HTTP/1.1" 200 None
2026-03-28 11:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 354bcfee-b8c8-5f58-8440-841270e7b99d with identifier: BW15%20VJX
2026-03-28 11:01:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 354bcfee-b8c8-5f58-8440-841270e7b99d with identifier: BW15%20VJX to the API
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW15%20VJX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '354bcfee-b8c8-5f58-8440-841270e7b99d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW15 VJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW15%20VJX&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 59109,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.6 DCI 130 DYNAMIQUE TOM TOM Coupe',
'transmission': 'manual',
'trim': 'DCI 130 DYNAMIQUE TOM TOM',
'vin': 'VF1DZNA0653321831',
'year': 2015}
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520VJX%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [bca.uk] INFO: Saving data for BW15%20VJX: {'auction_closing_time': 1774778400.0, 'created_time': 1774476902.861122, 'last_price_update_time': 1774695672.607232}
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW15%2520VJX') HTTP/1.1" 204 0
2026-03-28 11:01:12 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:01:12 [bca.uk] INFO: Found listing with ID: BJ67%20RFF
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ67%2520RFF%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [bca.uk] INFO: Scrape type for BJ67%20RFF: 0
2026-03-28 11:01:12 [bca.uk] INFO: Found listing with ID: CK17%20ZKE
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK17%2520ZKE%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [bca.uk] INFO: Scrape type for CK17%20ZKE: 0
2026-03-28 11:01:12 [bca.uk] INFO: Found listing with ID: YE15%20LBK
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520LBK%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [bca.uk] INFO: Scrape type for YE15%20LBK: 0
2026-03-28 11:01:12 [bca.uk] INFO: Found listing with ID: BF17%20UCH
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF17%2520UCH%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [bca.uk] INFO: Scrape type for BF17%20UCH: 0
2026-03-28 11:01:12 [bca.uk] INFO: Found listing with ID: FM16%20JXO
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM16%2520JXO%27 HTTP/1.1" 200 None
2026-03-28 11:01:12 [bca.uk] INFO: Scrape type for FM16%20JXO: 2
2026-03-28 11:01:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 58339331-9c77-54f6-b3ad-e20b7632bb21 with identifier: FM16%20JXO
2026-03-28 11:01:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 58339331-9c77-54f6-b3ad-e20b7632bb21 with scrape type 2
2026-03-28 11:01:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 58339331-9c77-54f6-b3ad-e20b7632bb21 with scrape type 2
2026-03-28 11:01:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 58339331-9c77-54f6-b3ad-e20b7632bb21, identifier: FM16%20JXO
2026-03-28 11:01:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 58339331-9c77-54f6-b3ad-e20b7632bb21 with identifier: FM16%20JXO
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=silver HTTP/1.1" 200 None
2026-03-28 11:01:12 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol HTTP/1.1" 200 None
2026-03-28 11:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 58339331-9c77-54f6-b3ad-e20b7632bb21 with identifier: FM16%20JXO
2026-03-28 11:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 58339331-9c77-54f6-b3ad-e20b7632bb21 with identifier: FM16%20JXO to the API
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM16%20JXO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '58339331-9c77-54f6-b3ad-e20b7632bb21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM16 JXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM16%20JXO&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 74639,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC Hatchback',
'transmission': 'automatic',
'trim': 'E/B 125 ZETEC',
'vin': 'WF05XXGCC5GC00242',
'year': 2016}
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM16%2520JXO%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [bca.uk] INFO: Saving data for FM16%20JXO: {'auction_closing_time': 1774864800.0, 'created_time': 1774563947.612661, 'last_price_update_time': 1774695673.416142}
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM16%2520JXO') HTTP/1.1" 204 0
2026-03-28 11:01:13 [bca.uk] INFO: Found listing with ID: WF67%20CFE
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520CFE%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [bca.uk] INFO: Scrape type for WF67%20CFE: 0
2026-03-28 11:01:13 [bca.uk] INFO: Found listing with ID: FJ59%20TSZ
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ59%2520TSZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [bca.uk] INFO: Scrape type for FJ59%20TSZ: 0
2026-03-28 11:01:13 [bca.uk] INFO: Found listing with ID: MV13%20TFX
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV13%2520TFX%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [bca.uk] INFO: Scrape type for MV13%20TFX: 0
2026-03-28 11:01:13 [bca.uk] INFO: Found listing with ID: WG62%20AOC
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520AOC%27 HTTP/1.1" 200 None
2026-03-28 11:01:13 [bca.uk] INFO: Scrape type for WG62%20AOC: 2
2026-03-28 11:01:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6dde5c6-1cb3-513e-aed7-72339019f886 with identifier: WG62%20AOC
2026-03-28 11:01:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6dde5c6-1cb3-513e-aed7-72339019f886 with scrape type 2
2026-03-28 11:01:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6dde5c6-1cb3-513e-aed7-72339019f886 with scrape type 2
2026-03-28 11:01:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f6dde5c6-1cb3-513e-aed7-72339019f886, identifier: WG62%20AOC
2026-03-28 11:01:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f6dde5c6-1cb3-513e-aed7-72339019f886 with identifier: WG62%20AOC
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=red HTTP/1.1" 200 None
2026-03-28 11:01:13 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f6dde5c6-1cb3-513e-aed7-72339019f886 with identifier: WG62%20AOC
2026-03-28 11:01:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f6dde5c6-1cb3-513e-aed7-72339019f886 with identifier: WG62%20AOC to the API
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG62%20AOC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f6dde5c6-1cb3-513e-aed7-72339019f886',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG62 AOC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WG62%20AOC&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'C250',
'odometer': 108936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C250 2.1 CDI B/E AMG SPORT PLUS Coupe',
'transmission': 'manual',
'trim': 'CDI B/E AMG SPORT PLUS',
'vin': 'WDD2043032G025919',
'year': 2012}
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520AOC%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Saving data for WG62%20AOC: {'auction_closing_time': 1774864800.0, 'created_time': 1774563936.093729, 'last_price_update_time': 1774695674.097198}
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WG62%2520AOC') HTTP/1.1" 204 0
2026-03-28 11:01:14 [bca.uk] INFO: Found listing with ID: BT13%20WSV
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WSV%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Scrape type for BT13%20WSV: 1
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:01:14 [bca.uk] INFO: Found listing with ID: DX16%20MYY
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520MYY%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Scrape type for DX16%20MYY: 1
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:01:14 [bca.uk] INFO: Found listing with ID: WN58%20UCF
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN58%2520UCF%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Scrape type for WN58%20UCF: 1
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 408cf7cd-5c88-5b19-ae14-d015866edb29 with identifier: WN58%20UCF
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:01:14 [bca.uk] INFO: Found listing with ID: CV68%20XCO
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV68%2520XCO%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Scrape type for CV68%20XCO: 2
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b987618e-f203-5896-bfd7-8999af2cc34a with scrape type 2
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b987618e-f203-5896-bfd7-8999af2cc34a with scrape type 2
2026-03-28 11:01:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b987618e-f203-5896-bfd7-8999af2cc34a, identifier: CV68%20XCO
2026-03-28 11:01:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=white HTTP/1.1" 200 None
2026-03-28 11:01:14 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO
2026-03-28 11:01:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b987618e-f203-5896-bfd7-8999af2cc34a with identifier: CV68%20XCO to the API
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV68%20XCO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b987618e-f203-5896-bfd7-8999af2cc34a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV68 XCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV68%20XCO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'STONIC',
'odometer': 55130,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA STONIC 1.0 T GDI 120 4 Hatchback',
'transmission': 'automatic',
'trim': 'T GDI 120 4',
'vin': 'KNAD6811VK6211357',
'year': 2018}
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV68%2520XCO%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Saving data for CV68%20XCO: {'auction_closing_time': 1774778400.0, 'created_time': 1774564544.657771, 'last_price_update_time': 1774695674.858935}
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV68%2520XCO') HTTP/1.1" 204 0
2026-03-28 11:01:14 [bca.uk] INFO: Found listing with ID: VU18%20ACY
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU18%2520ACY%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Scrape type for VU18%20ACY: 0
2026-03-28 11:01:14 [bca.uk] INFO: Found listing with ID: YH19%20WFS
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520WFS%27 HTTP/1.1" 200 None
2026-03-28 11:01:14 [bca.uk] INFO: Scrape type for YH19%20WFS: 2
2026-03-28 11:01:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1c6c3b83-6498-5b34-bcc3-bb6705d220cf with identifier: YH19%20WFS
2026-03-28 11:01:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1c6c3b83-6498-5b34-bcc3-bb6705d220cf with scrape type 2
2026-03-28 11:01:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1c6c3b83-6498-5b34-bcc3-bb6705d220cf with scrape type 2
2026-03-28 11:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1c6c3b83-6498-5b34-bcc3-bb6705d220cf, identifier: YH19%20WFS
2026-03-28 11:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1c6c3b83-6498-5b34-bcc3-bb6705d220cf with identifier: YH19%20WFS
2026-03-28 11:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1c6c3b83-6498-5b34-bcc3-bb6705d220cf with identifier: YH19%20WFS
2026-03-28 11:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1c6c3b83-6498-5b34-bcc3-bb6705d220cf with identifier: YH19%20WFS to the API
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH19%20WFS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1c6c3b83-6498-5b34-bcc3-bb6705d220cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH19 WFS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH19%20WFS&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '118I',
'odometer': 83299,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 M SPORT SHADOW ED.STEP Hatchback',
'transmission': 'automatic',
'trim': 'M SPORT SHADOW ED.STEP',
'vin': 'WBA1R520707D43609',
'year': 2019}
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520WFS%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Saving data for YH19%20WFS: {'auction_closing_time': 1774778400.0, 'created_time': 1774564562.35383, 'last_price_update_time': 1774695675.34954}
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH19%2520WFS') HTTP/1.1" 204 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: OE68%20NPP
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520NPP%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for OE68%20NPP: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: BT71%20ZWP
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT71%2520ZWP%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for BT71%20ZWP: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: CV23%20JXZ
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV23%2520JXZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for CV23%20JXZ: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: VA19%20TJU
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520TJU%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for VA19%20TJU: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: VN73%20XUO
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN73%2520XUO%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for VN73%20XUO: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: WP68%20JYS
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP68%2520JYS%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for WP68%20JYS: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: YS18%20GXM
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520GXM%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for YS18%20GXM: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: MT18%20EXX
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT18%2520EXX%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for MT18%20EXX: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: WG68%20NGF
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG68%2520NGF%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for WG68%20NGF: 0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: WK70%20VKG
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520VKG%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for WK70%20VKG: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: DX15%20JFF
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX15%2520JFF%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for DX15%20JFF: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cbb3191-6cbb-56b9-a02d-5948ba86518e with identifier: DX15%20JFF
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: BL57%20MXT
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL57%2520MXT%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for BL57%20MXT: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e488065-6fe4-54f4-8f63-4ae87132ae79 with identifier: BL57%20MXT
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: BD08%20AYG
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD08%2520AYG%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for BD08%20AYG: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f403886d-03c6-5fb8-8b41-8c5d5e920a1a with identifier: BD08%20AYG
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: BK05%20KCN
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK05%2520KCN%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for BK05%20KCN: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4285709e-1eb4-5199-8692-2365a9114f52 with identifier: BK05%20KCN
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: CE58%20JHU
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE58%2520JHU%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for CE58%20JHU: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 with identifier: CE58%20JHU
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: KW55%20WSO
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW55%2520WSO%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for KW55%20WSO: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a76f855b-ad2f-5512-95a5-962ebc6ded4f with identifier: KW55%20WSO
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: VN54%20DZL
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN54%2520DZL%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for VN54%20DZL: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d5df6b-48cf-580f-b920-c2fa62de29df with identifier: VN54%20DZL
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 46d5df6b-48cf-580f-b920-c2fa62de29df
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: YC60%20AWJ
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC60%2520AWJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for YC60%20AWJ: 1
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3c1070f3-e634-5279-aa25-131d59b68f50 with identifier: YC60%20AWJ
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:01:15 [bca.uk] INFO: Found listing with ID: LL66%20JRX
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520JRX%27 HTTP/1.1" 200 None
2026-03-28 11:01:15 [bca.uk] INFO: Scrape type for LL66%20JRX: 2
2026-03-28 11:01:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX
2026-03-28 11:01:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with scrape type 2
2026-03-28 11:01:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with scrape type 2
2026-03-28 11:01:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23, identifier: LL66%20JRX
2026-03-28 11:01:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX
2026-03-28 11:01:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX
2026-03-28 11:01:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 40faa241-815a-5e8b-ab3e-77f5ab6c5e23 with identifier: LL66%20JRX to the API
2026-03-28 11:01:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL66%20JRX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '40faa241-815a-5e8b-ab3e-77f5ab6c5e23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL66 JRX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL66%20JRX&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'KUGA',
'odometer': 63265,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 180 4WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 180 4WD TITANIUM',
'vin': 'WF0AXXWPMAGL37930',
'year': 2016}
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520JRX%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [bca.uk] INFO: Saving data for LL66%20JRX: {'auction_closing_time': 1774778400.0, 'created_time': 1774564531.359991, 'last_price_update_time': 1774695676.227964}
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL66%2520JRX') HTTP/1.1" 204 0
2026-03-28 11:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT13%20WSV-GB>
2026-03-28 11:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX16%20MYY-GB>
2026-03-28 11:01:16 [bca.uk] INFO: Found listing with ID: SM14%20UKA
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM14%2520UKA%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [bca.uk] INFO: Scrape type for SM14%20UKA: 2
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 13932844-a3e8-5dee-8682-aa296527260a with identifier: SM14%20UKA
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 13932844-a3e8-5dee-8682-aa296527260a with scrape type 2
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 13932844-a3e8-5dee-8682-aa296527260a with scrape type 2
2026-03-28 11:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 13932844-a3e8-5dee-8682-aa296527260a, identifier: SM14%20UKA
2026-03-28 11:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN58%20UCF-GB>
2026-03-28 11:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 13932844-a3e8-5dee-8682-aa296527260a with identifier: SM14%20UKA
2026-03-28 11:01:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 13932844-a3e8-5dee-8682-aa296527260a with identifier: SM14%20UKA
2026-03-28 11:01:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 13932844-a3e8-5dee-8682-aa296527260a with identifier: SM14%20UKA to the API
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM14%20UKA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '13932844-a3e8-5dee-8682-aa296527260a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM14 UKA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM14%20UKA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 95986,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.6 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'TSMNZA32S00404494',
'year': 2014}
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM14%2520UKA%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [bca.uk] INFO: Saving data for SM14%20UKA: {'auction_closing_time': 1774778400.0, 'created_time': 1774564542.473185, 'last_price_update_time': 1774695676.786863}
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM14%2520UKA') HTTP/1.1" 204 0
2026-03-28 11:01:16 [bca.uk] INFO: Found listing with ID: WG14%20SMV
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG14%2520SMV%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [bca.uk] INFO: Scrape type for WG14%20SMV: 0
2026-03-28 11:01:16 [bca.uk] INFO: Found listing with ID: BT65%20DVV
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT65%2520DVV%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [bca.uk] INFO: Scrape type for BT65%20DVV: 0
2026-03-28 11:01:16 [bca.uk] INFO: Found listing with ID: DC16%20EVN
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520EVN%27 HTTP/1.1" 200 None
2026-03-28 11:01:16 [bca.uk] INFO: Scrape type for DC16%20EVN: 2
2026-03-28 11:01:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN
2026-03-28 11:01:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1fda0444-b1a0-54b3-9742-73617145762b with scrape type 2
2026-03-28 11:01:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1fda0444-b1a0-54b3-9742-73617145762b with scrape type 2
2026-03-28 11:01:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1fda0444-b1a0-54b3-9742-73617145762b, identifier: DC16%20EVN
2026-03-28 11:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK70%20VKG-GB>
2026-03-28 11:01:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX15%20JFF-GB>
2026-03-28 11:01:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN
2026-03-28 11:01:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=grey HTTP/1.1" 200 None
2026-03-28 11:01:17 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN
2026-03-28 11:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1fda0444-b1a0-54b3-9742-73617145762b with identifier: DC16%20EVN to the API
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DC16%20EVN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1fda0444-b1a0-54b3-9742-73617145762b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DC16 EVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DC16%20EVN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': '335D',
'odometer': 51581,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW 335D 3.0 XDRIVE M SPORT STEP Saloon',
'transmission': 'automatic',
'trim': 'XDRIVE M SPORT STEP',
'vin': 'WBA8F72080K820397',
'year': 2016}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC16%2520EVN%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [bca.uk] INFO: Saving data for DC16%20EVN: {'auction_closing_time': 1774778400.0, 'created_time': 1774564563.792291, 'last_price_update_time': 1774695677.419646}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DC16%2520EVN') HTTP/1.1" 204 0
2026-03-28 11:01:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW55WSO/42807921?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=ECObaVyd9gRgz05Xmcp%2BESM7xLmJDF9h2X%2FEVj26GEo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KW55%20WSO-GB>
2026-03-28 11:01:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN54DZL/42808137?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=qf0jPnBs9kEZx0kCISPWyAnTF5%2FHmUBTBzEUSHUjgwM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN54%20DZL-GB>
2026-03-28 11:01:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE58%20JHU-GB>
2026-03-28 11:01:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL57%20MXT-GB>
2026-03-28 11:01:17 [bca.uk] INFO: Found listing with ID: DL17%20GHX
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL17%2520GHX%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [bca.uk] INFO: Scrape type for DL17%20GHX: 0
2026-03-28 11:01:17 [bca.uk] INFO: Found listing with ID: DS17%20WZL
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS17%2520WZL%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [bca.uk] INFO: Scrape type for DS17%20WZL: 0
2026-03-28 11:01:17 [bca.uk] INFO: Found listing with ID: DV64%20UEP
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520UEP%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [bca.uk] INFO: Scrape type for DV64%20UEP: 2
2026-03-28 11:01:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4841aad-e5f3-580f-a8b1-00c616bfea45 with identifier: DV64%20UEP
2026-03-28 11:01:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4841aad-e5f3-580f-a8b1-00c616bfea45 with scrape type 2
2026-03-28 11:01:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4841aad-e5f3-580f-a8b1-00c616bfea45 with scrape type 2
2026-03-28 11:01:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4841aad-e5f3-580f-a8b1-00c616bfea45, identifier: DV64%20UEP
2026-03-28 11:01:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD08%20AYG-GB>
2026-03-28 11:01:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4841aad-e5f3-580f-a8b1-00c616bfea45 with identifier: DV64%20UEP
2026-03-28 11:01:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4841aad-e5f3-580f-a8b1-00c616bfea45 with identifier: DV64%20UEP
2026-03-28 11:01:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4841aad-e5f3-580f-a8b1-00c616bfea45 with identifier: DV64%20UEP to the API
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV64%20UEP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e4841aad-e5f3-580f-a8b1-00c616bfea45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV64 UEP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV64%20UEP&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 93074,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'ACENTA PREMIUM',
'vin': 'SJNTAAE12U1086146',
'year': 2014}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520UEP%27 HTTP/1.1" 200 None
2026-03-28 11:01:17 [bca.uk] INFO: Saving data for DV64%20UEP: {'auction_closing_time': 1774778400.0, 'created_time': 1774476135.842525, 'last_price_update_time': 1774695677.98381}
2026-03-28 11:01:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV64%2520UEP') HTTP/1.1" 204 0
2026-03-28 11:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC60AWJ/42808422?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=RQQ4sN7yvoCoEuv1AhH2XXwb0rtF4sUe2LFKtHE6sHE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC60%20AWJ-GB>
2026-03-28 11:01:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK05KCN/42808014?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=gANA8pybdk4x89IPcI7C6tEJdd9J09Ln4zVAzOu53iI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK05%20KCN-GB>
2026-03-28 11:01:18 [bca.uk] INFO: Found listing with ID: BG16%20VPU
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520VPU%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Scrape type for BG16%20VPU: 0
2026-03-28 11:01:18 [bca.uk] INFO: Found listing with ID: WG66%20DHY
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520DHY%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Scrape type for WG66%20DHY: 2
2026-03-28 11:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7bcb8304-34a9-5674-8538-e3c131b49576 with identifier: WG66%20DHY
2026-03-28 11:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7bcb8304-34a9-5674-8538-e3c131b49576 with scrape type 2
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7bcb8304-34a9-5674-8538-e3c131b49576 with scrape type 2
2026-03-28 11:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7bcb8304-34a9-5674-8538-e3c131b49576, identifier: WG66%20DHY
2026-03-28 11:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7bcb8304-34a9-5674-8538-e3c131b49576 with identifier: WG66%20DHY
2026-03-28 11:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7bcb8304-34a9-5674-8538-e3c131b49576 with identifier: WG66%20DHY
2026-03-28 11:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7bcb8304-34a9-5674-8538-e3c131b49576 with identifier: WG66%20DHY to the API
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG66%20DHY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7bcb8304-34a9-5674-8538-e3c131b49576',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG66 DHY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WG66%20DHY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C3',
'odometer': 71522,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.2 P/T 82 PLATINUM ETG Hatchback',
'transmission': 'automatic',
'trim': 'P/T 82 PLATINUM ETG',
'vin': 'VF7SCHMZ6GW645301',
'year': 2016}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520DHY%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Saving data for WG66%20DHY: {'auction_closing_time': 1774864800.0, 'created_time': 1774563926.478789, 'last_price_update_time': 1774695678.462314}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WG66%2520DHY') HTTP/1.1" 204 0
2026-03-28 11:01:18 [bca.uk] INFO: Found listing with ID: YK17%20ZRC
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520ZRC%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Scrape type for YK17%20ZRC: 2
2026-03-28 11:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6 with identifier: YK17%20ZRC
2026-03-28 11:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6 with scrape type 2
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6 with scrape type 2
2026-03-28 11:01:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6, identifier: YK17%20ZRC
2026-03-28 11:01:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6 with identifier: YK17%20ZRC
2026-03-28 11:01:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6 with identifier: YK17%20ZRC
2026-03-28 11:01:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6 with identifier: YK17%20ZRC to the API
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK17%20ZRC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'fb0a09ff-1b6d-5320-bbe9-4e9e0117e2c6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK17 ZRC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK17%20ZRC&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'BMW',
'model': 'X5',
'odometer': 117497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 40D M SPORT (7S) StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 40D M SPORT (7S)',
'vin': 'WBAKS620100V10549',
'year': 2017}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520ZRC%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Saving data for YK17%20ZRC: {'auction_closing_time': 1774864800.0, 'created_time': 1774188169.672866, 'last_price_update_time': 1774695678.936111}
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK17%2520ZRC') HTTP/1.1" 204 0
2026-03-28 11:01:18 [bca.uk] INFO: Found listing with ID: EN14%20ZRU
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN14%2520ZRU%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Scrape type for EN14%20ZRU: 0
2026-03-28 11:01:18 [bca.uk] INFO: Found listing with ID: KP66%20FXV
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP66%2520FXV%27 HTTP/1.1" 200 None
2026-03-28 11:01:18 [bca.uk] INFO: Scrape type for KP66%20FXV: 2
2026-03-28 11:01:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e72e89d2-7a41-582b-96b5-5d6e6a53ee46 with identifier: KP66%20FXV
2026-03-28 11:01:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e72e89d2-7a41-582b-96b5-5d6e6a53ee46 with scrape type 2
2026-03-28 11:01:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e72e89d2-7a41-582b-96b5-5d6e6a53ee46 with scrape type 2
2026-03-28 11:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e72e89d2-7a41-582b-96b5-5d6e6a53ee46, identifier: KP66%20FXV
2026-03-28 11:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e72e89d2-7a41-582b-96b5-5d6e6a53ee46 with identifier: KP66%20FXV
2026-03-28 11:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e72e89d2-7a41-582b-96b5-5d6e6a53ee46 with identifier: KP66%20FXV
2026-03-28 11:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e72e89d2-7a41-582b-96b5-5d6e6a53ee46 with identifier: KP66%20FXV to the API
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP66%20FXV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e72e89d2-7a41-582b-96b5-5d6e6a53ee46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP66 FXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP66%20FXV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'MERCEDES-BENZ',
'model': 'B180 D',
'odometer': 66494,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 D 1.5 SPORT EXECUTIVE DCT MPV',
'transmission': 'automatic',
'trim': 'SPORT EXECUTIVE DCT',
'vin': 'WDD2462122J417280',
'year': 2016}
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP66%2520FXV%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [bca.uk] INFO: Saving data for KP66%20FXV: {'auction_closing_time': 1774864800.0, 'created_time': 1774563921.481116, 'last_price_update_time': 1774695679.428484}
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP66%2520FXV') HTTP/1.1" 204 0
2026-03-28 11:01:19 [bca.uk] INFO: Found listing with ID: NU67%20NWA
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520NWA%27 HTTP/1.1" 200 None
2026-03-28 11:01:19 [bca.uk] INFO: Scrape type for NU67%20NWA: 2
2026-03-28 11:01:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1ab3301-3fe8-506d-adba-bc9ecfbe39c5 with identifier: NU67%20NWA
2026-03-28 11:01:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1ab3301-3fe8-506d-adba-bc9ecfbe39c5 with scrape type 2
2026-03-28 11:01:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1ab3301-3fe8-506d-adba-bc9ecfbe39c5 with scrape type 2
2026-03-28 11:01:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a1ab3301-3fe8-506d-adba-bc9ecfbe39c5, identifier: NU67%20NWA
2026-03-28 11:01:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a1ab3301-3fe8-506d-adba-bc9ecfbe39c5 with identifier: NU67%20NWA
2026-03-28 11:01:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a1ab3301-3fe8-506d-adba-bc9ecfbe39c5 with identifier: NU67%20NWA
2026-03-28 11:01:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a1ab3301-3fe8-506d-adba-bc9ecfbe39c5 with identifier: NU67%20NWA to the API
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NU67%20NWA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a1ab3301-3fe8-506d-adba-bc9ecfbe39c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NU67 NWA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NU67%20NWA&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 90947,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D 180 AWD R SPORT StationWagon',
'transmission': 'automatic',
'trim': 'D 180 AWD R SPORT',
'vin': 'SADCA2AN7JA276238',
'year': 2017}
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520NWA%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Saving data for NU67%20NWA: {'auction_closing_time': 1774864800.0, 'created_time': 1774563911.913649, 'last_price_update_time': 1774695680.05849}
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NU67%2520NWA') HTTP/1.1" 204 0
2026-03-28 11:01:20 [bca.uk] INFO: Found listing with ID: OY17%20FXG
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FXG%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Scrape type for OY17%20FXG: 0
2026-03-28 11:01:20 [bca.uk] INFO: Found listing with ID: SGZ%206140
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SGZ%25206140%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Scrape type for SGZ%206140: 2
2026-03-28 11:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcb3de6e-b68b-5b7d-b16d-35a97280daff with identifier: SGZ%206140
2026-03-28 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fcb3de6e-b68b-5b7d-b16d-35a97280daff with scrape type 2
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fcb3de6e-b68b-5b7d-b16d-35a97280daff with scrape type 2
2026-03-28 11:01:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fcb3de6e-b68b-5b7d-b16d-35a97280daff, identifier: SGZ%206140
2026-03-28 11:01:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fcb3de6e-b68b-5b7d-b16d-35a97280daff with identifier: SGZ%206140
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=gold HTTP/1.1" 200 None
2026-03-28 11:01:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Petrol%2FElectric HTTP/1.1" 200 None
2026-03-28 11:01:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fcb3de6e-b68b-5b7d-b16d-35a97280daff with identifier: SGZ%206140
2026-03-28 11:01:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fcb3de6e-b68b-5b7d-b16d-35a97280daff with identifier: SGZ%206140 to the API
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 55,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SGZ%206140-GB',
'category': 'Car',
'color': 'gold',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'fcb3de6e-b68b-5b7d-b16d-35a97280daff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SGZ 6140',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SGZ%206140&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VOLVO',
'model': 'XC60 RECHARGE',
'odometer': 114776,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VOLVO XC60 RECHARGE 2.0 T6 PHEV AWD INSCRIPTION EXPR. StationWagon',
'transmission': 'automatic',
'trim': 'T6 PHEV AWD INSCRIPTION EXPR.',
'vin': 'LYVUZBFVDMB717140',
'year': 2020}
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SGZ%25206140%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Saving data for SGZ%206140: {'auction_closing_time': 1774864800.0, 'created_time': 1774390092.396806, 'last_price_update_time': 1774695680.800762}
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SGZ%25206140') HTTP/1.1" 204 0
2026-03-28 11:01:20 [bca.uk] INFO: Found listing with ID: F6%20ENE
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27F6%2520ENE%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Scrape type for F6%20ENE: 0
2026-03-28 11:01:20 [bca.uk] INFO: Found listing with ID: SY63%20BZU
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520BZU%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Scrape type for SY63%20BZU: 1
2026-03-28 11:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU
2026-03-28 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 168964c4-009e-5f86-a5de-a609e726f9b5
2026-03-28 11:01:20 [bca.uk] INFO: Found listing with ID: WU10%20OBT
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU10%2520OBT%27 HTTP/1.1" 200 None
2026-03-28 11:01:20 [bca.uk] INFO: Scrape type for WU10%20OBT: 2
2026-03-28 11:01:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 08bb3e03-9361-5066-a315-e5a4557b307a with identifier: WU10%20OBT
2026-03-28 11:01:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 08bb3e03-9361-5066-a315-e5a4557b307a with scrape type 2
2026-03-28 11:01:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 08bb3e03-9361-5066-a315-e5a4557b307a with scrape type 2
2026-03-28 11:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 08bb3e03-9361-5066-a315-e5a4557b307a, identifier: WU10%20OBT
2026-03-28 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 08bb3e03-9361-5066-a315-e5a4557b307a with identifier: WU10%20OBT
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=blue HTTP/1.1" 200 None
2026-03-28 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 08bb3e03-9361-5066-a315-e5a4557b307a with identifier: WU10%20OBT
2026-03-28 11:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 08bb3e03-9361-5066-a315-e5a4557b307a with identifier: WU10%20OBT to the API
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU10%20OBT-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '08bb3e03-9361-5066-a315-e5a4557b307a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU10 OBT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU10%20OBT&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 115413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 S 275 PORTFOLIO Saloon',
'transmission': 'automatic',
'trim': 'D V6 S 275 PORTFOLIO',
'vin': 'SAJAC072XBNR86714',
'year': 2010}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU10%2520OBT%27 HTTP/1.1" 200 None
2026-03-28 11:01:21 [bca.uk] INFO: Saving data for WU10%20OBT: {'auction_closing_time': 1774864800.0, 'created_time': 1774563901.398229, 'last_price_update_time': 1774695681.494287}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU10%2520OBT') HTTP/1.1" 204 0
2026-03-28 11:01:21 [bca.uk] INFO: Found listing with ID: YA08%20OVK
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520OVK%27 HTTP/1.1" 200 None
2026-03-28 11:01:21 [bca.uk] INFO: Scrape type for YA08%20OVK: 2
2026-03-28 11:01:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 078bd227-f943-569a-93e2-c217e9b73feb with identifier: YA08%20OVK
2026-03-28 11:01:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 078bd227-f943-569a-93e2-c217e9b73feb with scrape type 2
2026-03-28 11:01:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 078bd227-f943-569a-93e2-c217e9b73feb with scrape type 2
2026-03-28 11:01:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 078bd227-f943-569a-93e2-c217e9b73feb, identifier: YA08%20OVK
2026-03-28 11:01:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 078bd227-f943-569a-93e2-c217e9b73feb with identifier: YA08%20OVK
2026-03-28 11:01:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 078bd227-f943-569a-93e2-c217e9b73feb with identifier: YA08%20OVK
2026-03-28 11:01:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 078bd227-f943-569a-93e2-c217e9b73feb with identifier: YA08%20OVK to the API
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA08%20OVK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '078bd227-f943-569a-93e2-c217e9b73feb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA08 OVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA08%20OVK&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'LAND ROVER',
'model': 'FREELANDER 2',
'odometer': 117988,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'LAND ROVER FREELANDER 2 2.2 TD4 GS StationWagon',
'transmission': 'automatic',
'trim': 'TD4 GS',
'vin': 'SALFA23B39H114906',
'year': 2008}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA08%2520OVK%27 HTTP/1.1" 200 None
2026-03-28 11:01:21 [bca.uk] INFO: Saving data for YA08%20OVK: {'auction_closing_time': 1774864800.0, 'created_time': 1774563927.841231, 'last_price_update_time': 1774695681.950879}
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA08%2520OVK') HTTP/1.1" 204 0
2026-03-28 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:21 [bca.uk] INFO: Found listing with ID: FL59%20GYJ
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL59%2520GYJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:21 [bca.uk] INFO: Scrape type for FL59%20GYJ: 0
2026-03-28 11:01:21 [bca.uk] INFO: Found listing with ID: KR60%20ZHC
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR60%2520ZHC%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for KR60%20ZHC: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: KV61%20SXO
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV61%2520SXO%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for KV61%20SXO: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: MH07%20CHJ
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH07%2520CHJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for MH07%20CHJ: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: ND11%20FHJ
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND11%2520FHJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for ND11%20FHJ: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: T99%20NNO
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T99%2520NNO%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for T99%20NNO: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: YK22%20XJW
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520XJW%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for YK22%20XJW: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: AD22%20HLK
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD22%2520HLK%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for AD22%20HLK: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: AF20%20XAB
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF20%2520XAB%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for AF20%20XAB: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: CF19%20EJU
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF19%2520EJU%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for CF19%20EJU: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: DT21%20WNL
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT21%2520WNL%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for DT21%20WNL: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: FM19%20TVL
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TVL%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for FM19%20TVL: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: GV19%20DVR
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV19%2520DVR%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for GV19%20DVR: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: EJ18%20ZYC
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ18%2520ZYC%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for EJ18%20ZYC: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: MH16%20UOL
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH16%2520UOL%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for MH16%20UOL: 2
2026-03-28 11:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18de6cd9-deeb-52fa-905b-fc38e1f733ad with identifier: MH16%20UOL
2026-03-28 11:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18de6cd9-deeb-52fa-905b-fc38e1f733ad with scrape type 2
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18de6cd9-deeb-52fa-905b-fc38e1f733ad with scrape type 2
2026-03-28 11:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 18de6cd9-deeb-52fa-905b-fc38e1f733ad, identifier: MH16%20UOL
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 18de6cd9-deeb-52fa-905b-fc38e1f733ad with identifier: MH16%20UOL
2026-03-28 11:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 18de6cd9-deeb-52fa-905b-fc38e1f733ad with identifier: MH16%20UOL
2026-03-28 11:01:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 18de6cd9-deeb-52fa-905b-fc38e1f733ad with identifier: MH16%20UOL to the API
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MH16%20UOL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '18de6cd9-deeb-52fa-905b-fc38e1f733ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MH16 UOL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MH16%20UOL&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FORD',
'model': 'C-MAX',
'odometer': 31979,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD C-MAX 1.5 TDCI 120 TITANIUM P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 120 TITANIUM P/S',
'vin': 'WF0VXXGCEVGD44315',
'year': 2016}
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH16%2520UOL%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Saving data for MH16%20UOL: {'auction_closing_time': 1774778400.0, 'created_time': 1774565117.893592, 'last_price_update_time': 1774695682.658545}
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MH16%2520UOL') HTTP/1.1" 204 0
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: VU65%20FPP
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU65%2520FPP%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for VU65%20FPP: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: BF58%20VKL
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF58%2520VKL%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for BF58%20VKL: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: DU17%20VHK
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520VHK%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for DU17%20VHK: 0
2026-03-28 11:01:22 [bca.uk] INFO: Found listing with ID: EN63%20CGG
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN63%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 11:01:22 [bca.uk] INFO: Scrape type for EN63%20CGG: 2
2026-03-28 11:01:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e36e7240-66b8-524b-9626-274a6e6eae8c with identifier: EN63%20CGG
2026-03-28 11:01:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e36e7240-66b8-524b-9626-274a6e6eae8c with scrape type 2
2026-03-28 11:01:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e36e7240-66b8-524b-9626-274a6e6eae8c with scrape type 2
2026-03-28 11:01:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e36e7240-66b8-524b-9626-274a6e6eae8c, identifier: EN63%20CGG
2026-03-28 11:01:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e36e7240-66b8-524b-9626-274a6e6eae8c with identifier: EN63%20CGG
2026-03-28 11:01:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e36e7240-66b8-524b-9626-274a6e6eae8c with identifier: EN63%20CGG
2026-03-28 11:01:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e36e7240-66b8-524b-9626-274a6e6eae8c with identifier: EN63%20CGG to the API
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN63%20CGG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e36e7240-66b8-524b-9626-274a6e6eae8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN63 CGG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN63%20CGG&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'SUZUKI',
'model': 'SPLASH',
'odometer': 25655,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SUZUKI SPLASH 1.0 SZ2 Hatchback',
'transmission': 'manual',
'trim': 'SZ2',
'vin': 'TSMEXB22S00805374',
'year': 2014}
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN63%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [bca.uk] INFO: Saving data for EN63%20CGG: {'auction_closing_time': 1774778400.0, 'created_time': 1774565113.265679, 'last_price_update_time': 1774695683.431866}
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN63%2520CGG') HTTP/1.1" 204 0
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Using managed identity for Azure Blob Storage
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Using managed identity with client ID: 39192755-105d-4ce2-a21d-ab53b63f8b87
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac48e710>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): login.microsoftonline.com:443
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://login.microsoftonline.com:443 "POST /8ea908c1-4e85-4692-bc3f-3646b9b40891/oauth2/v2.0/token HTTP/1.1" 200 2117
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): alxproduction.blob.core.windows.net:443
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_expert_report_file_1b5bc984-71db-44b9-b340-4d1259238a5a.pdf HTTP/1.1" 201 0
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cbb3191-6cbb-56b9-a02d-5948ba86518e, skipping ID generation
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDX15JFF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX15JFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb47090>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_expert_report_file_e741c999-cae1-40e3-b29d-b08cd497670e.pdf HTTP/1.1" 201 0
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b761556c-b9e2-584e-8b60-6ef79cfe0123, skipping ID generation
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDX16MYY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX16MYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb37d10>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_expert_report_file_70285c88-ec07-45d7-ad23-b8edfe3c69c0.pdf HTTP/1.1" 201 0
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e488065-6fe4-54f4-8f63-4ae87132ae79, skipping ID generation
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBL57MXT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL57MXT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY63BZU/42808482?sv=2020-08-04&st=2026-03-28T11%3A01%3A22Z&se=2026-03-28T11%3A26%3A22Z&sr=b&sp=r&sig=LlsOSbfKIKjSKJCEN78xvAhc3w7ylaq7WfCAciHM4Gk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY63%20BZU-GB>
2026-03-28 11:01:23 [bca.uk] INFO: Found listing with ID: AO10%20XMX
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO10%2520XMX%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [bca.uk] INFO: Scrape type for AO10%20XMX: 1
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5bbf001-2c29-5121-9c1a-a03d8dd8d924 with identifier: AO10%20XMX
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798645%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798645 not downloaded yet
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802612%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802612 not downloaded yet
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915545%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915545 not downloaded yet
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea77fd0>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_expert_report_file_9d147983-bab0-45dc-8c26-0bf506d09dde.pdf HTTP/1.1" 201 0
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21, skipping ID generation
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWK70VKG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WK70VKG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea673d0>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_expert_report_file_5d92f9a1-71bc-44d6-9863-100d47e887c5.pdf HTTP/1.1" 201 0
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ed2dcfb-35de-5ada-ad91-353ae2183e85, skipping ID generation
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBT13WSV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT13WSV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea63350>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_expert_report_file_ed193d62-783f-4a4b-82c2-f70db407762d.pdf HTTP/1.1" 201 0
2026-03-28 11:01:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:01:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0, skipping ID generation
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCE58JHU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE58JHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7c390>
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_expert_report_file_4352c607-02c9-40bc-9534-c927f88e8e76.pdf HTTP/1.1" 201 0
2026-03-28 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 408cf7cd-5c88-5b19-ae14-d015866edb29, skipping ID generation
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWN58UCF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN58UCF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:24 [bca.uk] INFO: Found listing with ID: CY09%20BAO
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY09%2520BAO%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [bca.uk] INFO: Scrape type for CY09%20BAO: 1
2026-03-28 11:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 588b08c0-ef55-564c-b608-730d17562cf4 with identifier: CY09%20BAO
2026-03-28 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 588b08c0-ef55-564c-b608-730d17562cf4
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW55WSO/42807921?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=ECObaVyd9gRgz05Xmcp%2BESM7xLmJDF9h2X%2FEVj26GEo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC60AWJ/42808422?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=RQQ4sN7yvoCoEuv1AhH2XXwb0rtF4sUe2LFKtHE6sHE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK05KCN/42808014?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=gANA8pybdk4x89IPcI7C6tEJdd9J09Ln4zVAzOu53iI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798655%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798655 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802630%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802630 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915572%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915572 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915573%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915573 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802581%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802581 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818297%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818297 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802610%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802610 not downloaded yet
2026-03-28 11:01:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN54DZL/42808137?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=qf0jPnBs9kEZx0kCISPWyAnTF5%2FHmUBTBzEUSHUjgwM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:24 [bca.uk] INFO: Found listing with ID: HN54%20ZBG
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN54%2520ZBG%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [bca.uk] INFO: Scrape type for HN54%20ZBG: 2
2026-03-28 11:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea with identifier: HN54%20ZBG
2026-03-28 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea with scrape type 2
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea with scrape type 2
2026-03-28 11:01:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea, identifier: HN54%20ZBG
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb69810>
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_expert_report_file_6e358888-d3d7-4e54-9a2b-a80de8a9fd65.pdf HTTP/1.1" 201 0
2026-03-28 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:01:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f403886d-03c6-5fb8-8b41-8c5d5e920a1a, skipping ID generation
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD08AYG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD08AYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea with identifier: HN54%20ZBG
2026-03-28 11:01:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea with identifier: HN54%20ZBG
2026-03-28 11:01:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea with identifier: HN54%20ZBG to the API
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 200,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HN54%20ZBG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55708a6d-43ed-5f39-bfe8-70b7e0d5d0ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HN54 ZBG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HN54%20ZBG&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 119036,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 LX Estate',
'transmission': 'automatic',
'trim': 'LX',
'vin': 'WF0NXXWPDN4S00736',
'year': 2004}
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN54%2520ZBG%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [bca.uk] INFO: Saving data for HN54%20ZBG: {'auction_closing_time': 1774778400.0, 'created_time': 1774563916.471641, 'last_price_update_time': 1774695684.769297}
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HN54%2520ZBG') HTTP/1.1" 204 0
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798662%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798662 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802648%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802648 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915600%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915600 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915594%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915594 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802602%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802602 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818336%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818336 not downloaded yet
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802631%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802631 not downloaded yet
2026-03-28 11:01:24 [bca.uk] INFO: Found listing with ID: LD55%20ULT
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD55%2520ULT%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [bca.uk] INFO: Scrape type for LD55%20ULT: 1
2026-03-28 11:01:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7 with identifier: LD55%20ULT
2026-03-28 11:01:24 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798644%27 HTTP/1.1" 200 None
2026-03-28 11:01:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798644 not downloaded yet
2026-03-28 11:01:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO10XMX/42807402?sv=2020-08-04&st=2026-03-28T11%3A01%3A24Z&se=2026-03-28T11%3A26%3A24Z&sr=b&sp=r&sig=%2Ft46ZMK1dLQsc9vWs76UVBm9TaQUF4oaW0FwSzdJzyA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO10%20XMX-GB>
2026-03-28 11:01:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798668%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798668 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802668%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802668 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915624%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915624 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915626%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915626 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802625%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802625 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818359%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818359 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802654%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802654 not downloaded yet
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea74590>
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_expert_report_file_4e1b40af-3e96-42a6-9165-33f650378858.pdf HTTP/1.1" 201 0
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a76f855b-ad2f-5512-95a5-962ebc6ded4f, skipping ID generation
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKW55WSO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KW55WSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9ef150>
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_expert_report_file_41fe7e38-6201-4553-bcf2-d8712c8967c4.pdf HTTP/1.1" 201 0
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c1070f3-e634-5279-aa25-131d59b68f50, skipping ID generation
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYC60AWJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YC60AWJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9ec550>
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_expert_report_file_ae33db86-af49-4f42-a781-061547ad83cc.pdf HTTP/1.1" 201 0
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4285709e-1eb4-5199-8692-2365a9114f52, skipping ID generation
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBK05KCN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK05KCN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e813890>
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_expert_report_file_81012564-0707-4cba-b88d-00a091286b79.pdf HTTP/1.1" 201 0
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 46d5df6b-48cf-580f-b920-c2fa62de29df
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46d5df6b-48cf-580f-b920-c2fa62de29df, skipping ID generation
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46d5df6b-48cf-580f-b920-c2fa62de29df
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVN54DZL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VN54DZL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:25 [bca.uk] INFO: Found listing with ID: BD17%20TZF
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520TZF%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [bca.uk] INFO: Scrape type for BD17%20TZF: 1
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798654%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798654 not downloaded yet
2026-03-28 11:01:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY63BZU/42808482?sv=2020-08-04&st=2026-03-28T11%3A01%3A22Z&se=2026-03-28T11%3A26%3A22Z&sr=b&sp=r&sig=LlsOSbfKIKjSKJCEN78xvAhc3w7ylaq7WfCAciHM4Gk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY09BAO/42808128?sv=2020-08-04&st=2026-03-28T11%3A01%3A25Z&se=2026-03-28T11%3A26%3A25Z&sr=b&sp=r&sig=wcZ2JQQEPehEN9Fcf75fuGVql7uYPfjUl%2FAKf8RPsVI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY09%20BAO-GB>
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798675%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798675 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802687%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802687 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915646%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915646 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915636%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915636 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802640%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802640 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818373%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818373 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802671%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802671 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787492%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787492 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814304%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814304 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798636%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798636 not downloaded yet
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798665%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798665 not downloaded yet
2026-03-28 11:01:25 [bca.uk] INFO: Found listing with ID: CU18%20AXX
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU18%2520AXX%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [bca.uk] INFO: Scrape type for CU18%20AXX: 2
2026-03-28 11:01:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ca760025-af2c-58c6-80a9-791cdf3f57c3 with identifier: CU18%20AXX
2026-03-28 11:01:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ca760025-af2c-58c6-80a9-791cdf3f57c3 with scrape type 2
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ca760025-af2c-58c6-80a9-791cdf3f57c3 with scrape type 2
2026-03-28 11:01:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ca760025-af2c-58c6-80a9-791cdf3f57c3, identifier: CU18%20AXX
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798661%27 HTTP/1.1" 200 None
2026-03-28 11:01:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798661 not downloaded yet
2026-03-28 11:01:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ca760025-af2c-58c6-80a9-791cdf3f57c3 with identifier: CU18%20AXX
2026-03-28 11:01:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ca760025-af2c-58c6-80a9-791cdf3f57c3 with identifier: CU18%20AXX
2026-03-28 11:01:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ca760025-af2c-58c6-80a9-791cdf3f57c3 with identifier: CU18%20AXX to the API
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 53,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CU18%20AXX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'ca760025-af2c-58c6-80a9-791cdf3f57c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CU18 AXX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CU18%20AXX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'C350 E',
'odometer': 119464,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C350 E 2.0 AMG LINE PREMIUM PLUS Estate',
'transmission': 'manual',
'trim': 'AMG LINE PREMIUM PLUS',
'vin': 'WDD2052472F719951',
'year': 2018}
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU18%2520AXX%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [bca.uk] INFO: Saving data for CU18%20AXX: {'auction_closing_time': 1774864800.0, 'created_time': 1774563896.413132, 'last_price_update_time': 1774695686.000424}
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CU18%2520AXX') HTTP/1.1" 204 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798689%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798689 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802711%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802711 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915668%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915668 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915645%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915645 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802662%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802662 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818387%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818387 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802686%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802686 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787499%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787499 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814318%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814318 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798641%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798641 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798673%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798673 not downloaded yet
2026-03-28 11:01:26 [bca.uk] INFO: Found listing with ID: LK65%20VPG
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520VPG%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [bca.uk] INFO: Scrape type for LK65%20VPG: 2
2026-03-28 11:01:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b with identifier: LK65%20VPG
2026-03-28 11:01:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b with scrape type 2
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b with scrape type 2
2026-03-28 11:01:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b, identifier: LK65%20VPG
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798670%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798670 not downloaded yet
2026-03-28 11:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BL57MXT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX15JFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX16MYY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b with identifier: LK65%20VPG
2026-03-28 11:01:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b with identifier: LK65%20VPG
2026-03-28 11:01:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2fbb28a8-d1b6-5811-b27d-2cd34dbac90b with identifier: LK65%20VPG to the API
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK65%20VPG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2fbb28a8-d1b6-5811-b27d-2cd34dbac90b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK65 VPG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK65%20VPG&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JEEP',
'model': 'CHEROKEE',
'odometer': 106516,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'JEEP CHEROKEE 2.2 M/JET 200 4WD LIMITED StationWagon',
'transmission': 'automatic',
'trim': 'M/JET 200 4WD LIMITED',
'vin': '1C4PJMHU0FW771493',
'year': 2015}
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK65%2520VPG%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [bca.uk] INFO: Saving data for LK65%20VPG: {'auction_closing_time': 1774864800.0, 'created_time': 1774476207.835656, 'last_price_update_time': 1774695686.732379}
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK65%2520VPG') HTTP/1.1" 204 0
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798707%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798707 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802731%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802731 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915692%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915692 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915669%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915669 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802690%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802690 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818412%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818412 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802709%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802709 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787506%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787506 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814332%27 HTTP/1.1" 200 None
2026-03-28 11:01:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814332 not downloaded yet
2026-03-28 11:01:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798649%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798649 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798681%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798681 not downloaded yet
2026-03-28 11:01:27 [bca.uk] INFO: Found listing with ID: NJ18%20YDM
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ18%2520YDM%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [bca.uk] INFO: Scrape type for NJ18%20YDM: 1
2026-03-28 11:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM
2026-03-28 11:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798677%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798677 not downloaded yet
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eabb290>
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_168964c4-009e-5f86-a5de-a609e726f9b5/168964c4-009e-5f86-a5de-a609e726f9b5_expert_report_file_2c91661d-7fab-40bc-9139-9fb4e426face.pdf HTTP/1.1" 201 0
2026-03-28 11:01:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 168964c4-009e-5f86-a5de-a609e726f9b5
2026-03-28 11:01:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 168964c4-009e-5f86-a5de-a609e726f9b5, skipping ID generation
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 168964c4-009e-5f86-a5de-a609e726f9b5
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSY63BZU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SY63BZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798716%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798716 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802750%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802750 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915717%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915717 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915699%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915699 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802722%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802722 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818438%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818438 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802735%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802735 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787517%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787517 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814352%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814352 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798658%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798658 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798685%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798685 not downloaded yet
2026-03-28 11:01:27 [bca.uk] INFO: Found listing with ID: OV20%20KUN
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520KUN%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [bca.uk] INFO: Scrape type for OV20%20KUN: 0
2026-03-28 11:01:27 [bca.uk] INFO: Found listing with ID: WD67%20HAX
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD67%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [bca.uk] INFO: Scrape type for WD67%20HAX: 2
2026-03-28 11:01:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3fcfb023-f54c-54e8-b595-28a52c8b7f1e with identifier: WD67%20HAX
2026-03-28 11:01:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3fcfb023-f54c-54e8-b595-28a52c8b7f1e with scrape type 2
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3fcfb023-f54c-54e8-b595-28a52c8b7f1e with scrape type 2
2026-03-28 11:01:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3fcfb023-f54c-54e8-b595-28a52c8b7f1e, identifier: WD67%20HAX
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798692%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798692 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818395%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818395 not downloaded yet
2026-03-28 11:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802575/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN58UCF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802610>
2026-03-28 11:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CE58JHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798645>
2026-03-28 11:01:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802612/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802612>
2026-03-28 11:01:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3fcfb023-f54c-54e8-b595-28a52c8b7f1e with identifier: WD67%20HAX
2026-03-28 11:01:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3fcfb023-f54c-54e8-b595-28a52c8b7f1e with identifier: WD67%20HAX
2026-03-28 11:01:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3fcfb023-f54c-54e8-b595-28a52c8b7f1e with identifier: WD67%20HAX to the API
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD67%20HAX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3fcfb023-f54c-54e8-b595-28a52c8b7f1e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD67 HAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD67%20HAX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'MERCEDES-BENZ',
'model': 'S350 D',
'odometer': 71202,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ S350 D 3.0 AMG LINE Saloon',
'transmission': 'manual',
'trim': 'AMG LINE',
'vin': 'WDD2220202A386948',
'year': 2018}
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD67%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [bca.uk] INFO: Saving data for WD67%20HAX: {'auction_closing_time': 1774864800.0, 'created_time': 1774563918.623605, 'last_price_update_time': 1774695687.85671}
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD67%2520HAX') HTTP/1.1" 204 0
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798729%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798729 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802766%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802766 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915743%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915743 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915724%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915724 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802746%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802746 not downloaded yet
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818462%27 HTTP/1.1" 200 None
2026-03-28 11:01:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818462 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802754%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802754 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787544%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787544 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814390%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814390 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798663%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798663 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798698%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798698 not downloaded yet
2026-03-28 11:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT13WSV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: VU13%20OVD
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU13%2520OVD%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for VU13%20OVD: 1
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af585fe7-11dd-51ed-a3c0-f086e4921a87 with identifier: VU13%20OVD
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item af585fe7-11dd-51ed-a3c0-f086e4921a87
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798708%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798708 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818408%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818408 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915749%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915749 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802762%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802762 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818479%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818479 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802769%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802769 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787559%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787559 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814424%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814424 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798674%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798674 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798705%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798705 not downloaded yet
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: KN14%20XZR
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN14%2520XZR%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for KN14%20XZR: 1
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77d92d9b-9b4d-5625-b538-e4504c499e0f with identifier: KN14%20XZR
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 77d92d9b-9b4d-5625-b538-e4504c499e0f
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798718%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798718 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818424%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818424 not downloaded yet
2026-03-28 11:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915545>
2026-03-28 11:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WK70VKG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798653/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VN54DZL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818297>
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787579%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787579 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814455%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814455 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798687%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798687 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798719%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798719 not downloaded yet
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: DL18%20NSO
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL18%2520NSO%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for DL18%20NSO: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: GV18%20EXP
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV18%2520EXP%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for GV18%20EXP: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: MP19%20OSZ
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520OSZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for MP19%20OSZ: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: RF21%20DKD
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF21%2520DKD%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for RF21%20DKD: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: VK22%20LGG
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK22%2520LGG%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for VK22%20LGG: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: YJ70%20TKD
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ70%2520TKD%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for YJ70%20TKD: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: MA62%20RAA
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA62%2520RAA%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for MA62%20RAA: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: LJ68%20TTK
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520TTK%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for LJ68%20TTK: 0
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: PX17%20MBO
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX17%2520MBO%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for PX17%20MBO: 1
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e92c795-afee-5372-9d8b-1d752dfd4a43 with identifier: PX17%20MBO
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3e92c795-afee-5372-9d8b-1d752dfd4a43
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798735%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798735 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818440%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818440 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787595%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787595 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814485%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814485 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798706%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798706 not downloaded yet
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798734%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798734 not downloaded yet
2026-03-28 11:01:28 [bca.uk] INFO: Found listing with ID: MF14%20BJJ
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF14%2520BJJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [bca.uk] INFO: Scrape type for MF14%20BJJ: 2
2026-03-28 11:01:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41f46bde-639c-5c92-873b-42d55d019a61 with identifier: MF14%20BJJ
2026-03-28 11:01:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 41f46bde-639c-5c92-873b-42d55d019a61 with scrape type 2
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 41f46bde-639c-5c92-873b-42d55d019a61 with scrape type 2
2026-03-28 11:01:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41f46bde-639c-5c92-873b-42d55d019a61, identifier: MF14%20BJJ
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818448%27 HTTP/1.1" 200 None
2026-03-28 11:01:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818448 not downloaded yet
2026-03-28 11:01:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41f46bde-639c-5c92-873b-42d55d019a61 with identifier: MF14%20BJJ
2026-03-28 11:01:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41f46bde-639c-5c92-873b-42d55d019a61 with identifier: MF14%20BJJ
2026-03-28 11:01:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41f46bde-639c-5c92-873b-42d55d019a61 with identifier: MF14%20BJJ to the API
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=1&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF14%20BJJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '41f46bde-639c-5c92-873b-42d55d019a61',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF14 BJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF14%20BJJ&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 42371,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 TDCI 163 TITANIUM X BUS.ED.P/S Hatchback',
'transmission': 'automatic',
'trim': 'TDCI 163 TITANIUM X BUS.ED.P/S',
'vin': 'WF0EXXGBBEEJ26655',
'year': 2014}
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF14%2520BJJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [bca.uk] INFO: Saving data for MF14%20BJJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774565114.763457, 'last_price_update_time': 1774695689.275648}
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF14%2520BJJ') HTTP/1.1" 204 0
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787614%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787614 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814515%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814515 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798720%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798720 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798741%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798741 not downloaded yet
2026-03-28 11:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO10XMX/42807402?sv=2020-08-04&st=2026-03-28T11%3A01%3A24Z&se=2026-03-28T11%3A26%3A24Z&sr=b&sp=r&sig=%2Ft46ZMK1dLQsc9vWs76UVBm9TaQUF4oaW0FwSzdJzyA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CY09BAO/42808128?sv=2020-08-04&st=2026-03-28T11%3A01%3A25Z&se=2026-03-28T11%3A26%3A25Z&sr=b&sp=r&sig=wcZ2JQQEPehEN9Fcf75fuGVql7uYPfjUl%2FAKf8RPsVI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:29 [bca.uk] INFO: Found listing with ID: MF16%20UTG
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520UTG%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [bca.uk] INFO: Scrape type for MF16%20UTG: 1
2026-03-28 11:01:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50d5ecca-764d-50fb-be83-8ecebd8cb459 with identifier: MF16%20UTG
2026-03-28 11:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 50d5ecca-764d-50fb-be83-8ecebd8cb459
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818470%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818470 not downloaded yet
2026-03-28 11:01:29 [bca.uk] INFO: Found listing with ID: PN65%20YXH
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN65%2520YXH%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [bca.uk] INFO: Scrape type for PN65%20YXH: 0
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818488%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818488 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818499%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818499 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818510%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818510 not downloaded yet
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa2790>
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b5bbf001-2c29-5121-9c1a-a03d8dd8d924/b5bbf001-2c29-5121-9c1a-a03d8dd8d924_expert_report_file_c572aff9-3fa6-405e-ab10-5671cf9ea69b.pdf HTTP/1.1" 201 0
2026-03-28 11:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924
2026-03-28 11:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b5bbf001-2c29-5121-9c1a-a03d8dd8d924, skipping ID generation
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAO10XMX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO10XMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4eaad0>
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_588b08c0-ef55-564c-b608-730d17562cf4/588b08c0-ef55-564c-b608-730d17562cf4_expert_report_file_da9edb12-18f0-4e0e-8763-20c3ab8331de.pdf HTTP/1.1" 201 0
2026-03-28 11:01:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 588b08c0-ef55-564c-b608-730d17562cf4
2026-03-28 11:01:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 588b08c0-ef55-564c-b608-730d17562cf4, skipping ID generation
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 588b08c0-ef55-564c-b608-730d17562cf4
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCY09BAO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CY09BAO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780283%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780283 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809456%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809456 not downloaded yet
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b761556c-b9e2-584e-8b60-6ef79cfe0123 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780292%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780292 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809471%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809471 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780298%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780298 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809483%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809483 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780309%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780309 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809498%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809498 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780315%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780315 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809515%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809515 not downloaded yet
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780323%27 HTTP/1.1" 200 None
2026-03-28 11:01:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780323 not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809540%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809540 not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780334%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780334 not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809563%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809563 not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780344%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780344 not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809578%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809578 not downloaded yet
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b761556c-b9e2-584e-8b60-6ef79cfe0123 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780355%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780355 not downloaded yet
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809596%27 HTTP/1.1" 200 None
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809596 not downloaded yet
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818448/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818448>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798734>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798741>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798720>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809515>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780315>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809498>
2026-03-28 11:01:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780309>
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 408cf7cd-5c88-5b19-ae14-d015866edb29 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 408cf7cd-5c88-5b19-ae14-d015866edb29 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:30 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809596>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780344>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809578>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780355>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809563>
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 4285709e-1eb4-5199-8692-2365a9114f52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780334>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780323/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780323>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780298/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780298>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809540>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809483/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809483>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809471>
2026-03-28 11:01:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780292>
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809456/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809456>
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:32 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780283>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CY09BAO/698809446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CY09BAO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO10XMX/698780277/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO10XMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818488/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818488>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818499>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818510>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818470>
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF16UTG/42805951?sv=2020-08-04&st=2026-03-28T11%3A01%3A33Z&se=2026-03-28T11%3A26%3A33Z&sr=b&sp=r&sig=gFQ9j0%2BOoW6Lsd6LXB5HQU4QNfs4mtFLcs1BpdMgQ8M%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF16%20UTG-GB>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814515>
2026-03-28 11:01:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787614>
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:33 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 588b08c0-ef55-564c-b608-730d17562cf4 with identifier: CY09%20BAO
2026-03-28 11:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 588b08c0-ef55-564c-b608-730d17562cf4 with identifier: CY09%20BAO
2026-03-28 11:01:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 588b08c0-ef55-564c-b608-730d17562cf4 with identifier: CY09%20BAO to the API
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:34 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_588b08c0-ef55-564c-b608-730d17562cf4/588b08c0-ef55-564c-b608-730d17562cf4_expert_report_file_da9edb12-18f0-4e0e-8763-20c3ab8331de.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY09%20BAO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '588b08c0-ef55-564c-b608-730d17562cf4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY09 BAO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CY09%20BAO&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 200810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CY09BAO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809456',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809471',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809483',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809498',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809515',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809540',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809563',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809578',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809596'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 82 STYLE + Hatchback',
'transmission': 'manual',
'trim': '82 STYLE +',
'vin': 'WF0JXXWPJJ9M04534',
'year': 2009}
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY09%2520BAO%27 HTTP/1.1" 200 None
2026-03-28 11:01:34 [bca.uk] INFO: Saving data for CY09%20BAO: {'created_time': 1774695694.776704, 'last_price_update_time': 1774695694.776717, 'auction_closing_time': 1774778400.0}
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CY09%2520BAO') HTTP/1.1" 204 0
2026-03-28 11:01:34 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 588b08c0-ef55-564c-b608-730d17562cf4 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF16UTG/42805951?sv=2020-08-04&st=2026-03-28T11%3A01%3A33Z&se=2026-03-28T11%3A26%3A33Z&sr=b&sp=r&sig=gFQ9j0%2BOoW6Lsd6LXB5HQU4QNfs4mtFLcs1BpdMgQ8M%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798706>
2026-03-28 11:01:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814485>
2026-03-28 11:01:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b5bbf001-2c29-5121-9c1a-a03d8dd8d924 with identifier: AO10%20XMX
2026-03-28 11:01:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b5bbf001-2c29-5121-9c1a-a03d8dd8d924 with identifier: AO10%20XMX
2026-03-28 11:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b5bbf001-2c29-5121-9c1a-a03d8dd8d924 with identifier: AO10%20XMX to the API
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:35 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b5bbf001-2c29-5121-9c1a-a03d8dd8d924/b5bbf001-2c29-5121-9c1a-a03d8dd8d924_expert_report_file_c572aff9-3fa6-405e-ab10-5671cf9ea69b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO10%20XMX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b5bbf001-2c29-5121-9c1a-a03d8dd8d924',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO10 XMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO10%20XMX&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'CHEVROLET',
'model': 'SPARK',
'odometer': 115088,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO10XMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780283',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780292',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780298',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780309',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780315',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780323',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780334',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780344',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780355'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'CHEVROLET SPARK 1.2 LS+ Hatchback',
'transmission': 'manual',
'trim': 'LS+',
'vin': 'KL1MF48D9AC176773',
'year': 2010}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO10%2520XMX%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [bca.uk] INFO: Saving data for AO10%20XMX: {'created_time': 1774695695.319937, 'last_price_update_time': 1774695695.319952, 'auction_closing_time': 1774778400.0}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO10%2520XMX') HTTP/1.1" 204 0
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787595>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818440/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818440>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX17MBO/42804330?sv=2020-08-04&st=2026-03-28T11%3A01%3A34Z&se=2026-03-28T11%3A26%3A34Z&sr=b&sp=r&sig=itZ4ucmlTJMft0rKjjO3nK7ACK3YfLMG0EZBjNxw3fw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX17%20MBO-GB>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798735>
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b5bbf001-2c29-5121-9c1a-a03d8dd8d924 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac466090>
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_50d5ecca-764d-50fb-be83-8ecebd8cb459/50d5ecca-764d-50fb-be83-8ecebd8cb459_expert_report_file_dceed780-0ddd-4a84-97b7-0e2051555885.pdf HTTP/1.1" 201 0
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 50d5ecca-764d-50fb-be83-8ecebd8cb459
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 50d5ecca-764d-50fb-be83-8ecebd8cb459, skipping ID generation
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 50d5ecca-764d-50fb-be83-8ecebd8cb459
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF16UTG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF16UTG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:35 [bca.uk] INFO: Total items found: 100
2026-03-28 11:01:35 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded
2026-03-28 11:01:35 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:01:35 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709140%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709140 not downloaded yet
2026-03-28 11:01:35 [bca.uk] INFO: Found listing with ID: BK11%20UNU
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK11%2520UNU%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [bca.uk] INFO: Scrape type for BK11%20UNU: 1
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b129378e-787d-57af-b4c0-c8af6440f1f9 with identifier: BK11%20UNU
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b129378e-787d-57af-b4c0-c8af6440f1f9
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818424>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798687>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787579/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787579>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798718>
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814455>
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709151%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709151 not downloaded yet
2026-03-28 11:01:35 [bca.uk] INFO: Found listing with ID: SN65%20NPD
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN65%2520NPD%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [bca.uk] INFO: Scrape type for SN65%20NPD: 2
2026-03-28 11:01:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9079119-47ac-5977-95b9-79f32c241065 with identifier: SN65%20NPD
2026-03-28 11:01:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9079119-47ac-5977-95b9-79f32c241065 with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9079119-47ac-5977-95b9-79f32c241065 with scrape type 2
2026-03-28 11:01:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d9079119-47ac-5977-95b9-79f32c241065, identifier: SN65%20NPD
2026-03-28 11:01:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798719>
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 3c1070f3-e634-5279-aa25-131d59b68f50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d9079119-47ac-5977-95b9-79f32c241065 with identifier: SN65%20NPD
2026-03-28 11:01:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d9079119-47ac-5977-95b9-79f32c241065 with identifier: SN65%20NPD
2026-03-28 11:01:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d9079119-47ac-5977-95b9-79f32c241065 with identifier: SN65%20NPD to the API
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN65%20NPD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd9079119-47ac-5977-95b9-79f32c241065',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN65 NPD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN65%20NPD&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 56258,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 0.9 TCE 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 DYNAMIQUE',
'vin': 'VF12RD11A53785729',
'year': 2015}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN65%2520NPD%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [bca.uk] INFO: Saving data for SN65%20NPD: {'auction_closing_time': 1774778400.0, 'created_time': 1774449090.759132, 'last_price_update_time': 1774695695.91789}
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN65%2520NPD') HTTP/1.1" 204 0
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709163%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709163 not downloaded yet
2026-03-28 11:01:35 [bca.uk] INFO: Found listing with ID: YH14%20PZJ
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520PZJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:35 [bca.uk] INFO: Scrape type for YH14%20PZJ: 0
2026-03-28 11:01:35 [bca.uk] INFO: Found listing with ID: YX64%20PZC
2026-03-28 11:01:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX64%2520PZC%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for YX64%20PZC: 0
2026-03-28 11:01:36 [bca.uk] INFO: Found listing with ID: K999%20ENP
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K999%2520ENP%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for K999%20ENP: 2
2026-03-28 11:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9338716-bcde-56a0-beac-8c634c67b91c with identifier: K999%20ENP
2026-03-28 11:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9338716-bcde-56a0-beac-8c634c67b91c with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9338716-bcde-56a0-beac-8c634c67b91c with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e9338716-bcde-56a0-beac-8c634c67b91c, identifier: K999%20ENP
2026-03-28 11:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN14XZR/42805338?sv=2020-08-04&st=2026-03-28T11%3A01%3A35Z&se=2026-03-28T11%3A26%3A35Z&sr=b&sp=r&sig=YE5tIpNAnX5DwXvXxzFsUqqgA2Le2hOPivwfPL4%2BZm4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN14%20XZR-GB>
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e9338716-bcde-56a0-beac-8c634c67b91c with identifier: K999%20ENP
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=grey%2Fblack HTTP/1.1" 200 None
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e9338716-bcde-56a0-beac-8c634c67b91c with identifier: K999%20ENP
2026-03-28 11:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e9338716-bcde-56a0-beac-8c634c67b91c with identifier: K999%20ENP to the API
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=K999%20ENP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e9338716-bcde-56a0-beac-8c634c67b91c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'K999 ENP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=K999%20ENP&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'ABARTH',
'model': '595',
'odometer': 8627,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'ABARTH 595 1.4 T-JET 180 COMPETIZIONE Hatchback',
'transmission': 'automatic',
'trim': 'T-JET 180 COMPETIZIONE',
'vin': 'ZFA3120000JB42805',
'year': 2019}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K999%2520ENP%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Saving data for K999%20ENP: {'auction_closing_time': 1774864800.0, 'created_time': 1774564552.496285, 'last_price_update_time': 1774695696.612943}
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='K999%2520ENP') HTTP/1.1" 204 0
2026-03-28 11:01:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798705>
2026-03-28 11:01:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX17MBO/42804330?sv=2020-08-04&st=2026-03-28T11%3A01%3A34Z&se=2026-03-28T11%3A26%3A34Z&sr=b&sp=r&sig=itZ4ucmlTJMft0rKjjO3nK7ACK3YfLMG0EZBjNxw3fw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709176%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709176 not downloaded yet
2026-03-28 11:01:36 [bca.uk] INFO: Found listing with ID: YN64%20VNE
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520VNE%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for YN64%20VNE: 1
2026-03-28 11:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 with identifier: YN64%20VNE
2026-03-28 11:01:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709190%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709190 not downloaded yet
2026-03-28 11:01:36 [bca.uk] INFO: Found listing with ID: YG64%20YPR
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520YPR%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for YG64%20YPR: 0
2026-03-28 11:01:36 [bca.uk] INFO: Found listing with ID: GG05%20AVG
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GG05%2520AVG%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for GG05%20AVG: 0
2026-03-28 11:01:36 [bca.uk] INFO: Found listing with ID: S706%20NFV
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S706%2520NFV%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for S706%20NFV: 0
2026-03-28 11:01:36 [bca.uk] INFO: Found listing with ID: MK62%20TKE
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK62%2520TKE%27 HTTP/1.1" 200 None
2026-03-28 11:01:36 [bca.uk] INFO: Scrape type for MK62%20TKE: 2
2026-03-28 11:01:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e87d1c8-5fd8-5507-b92a-33ab3f96b039 with identifier: MK62%20TKE
2026-03-28 11:01:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e87d1c8-5fd8-5507-b92a-33ab3f96b039 with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e87d1c8-5fd8-5507-b92a-33ab3f96b039 with scrape type 2
2026-03-28 11:01:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e87d1c8-5fd8-5507-b92a-33ab3f96b039, identifier: MK62%20TKE
2026-03-28 11:01:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e87d1c8-5fd8-5507-b92a-33ab3f96b039 with identifier: MK62%20TKE
2026-03-28 11:01:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e87d1c8-5fd8-5507-b92a-33ab3f96b039 with identifier: MK62%20TKE
2026-03-28 11:01:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e87d1c8-5fd8-5507-b92a-33ab3f96b039 with identifier: MK62%20TKE to the API
2026-03-28 11:01:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK62%20TKE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2e87d1c8-5fd8-5507-b92a-33ab3f96b039',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK62 TKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK62%20TKE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FIAT',
'model': '500',
'odometer': 70228,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE S/S Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE S/S',
'vin': 'ZFA31200000904199',
'year': 2012}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK62%2520TKE%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [bca.uk] INFO: Saving data for MK62%20TKE: {'auction_closing_time': 1774778400.0, 'created_time': 1774505377.309317, 'last_price_update_time': 1774695697.22745}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK62%2520TKE') HTTP/1.1" 204 0
2026-03-28 11:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798674>
2026-03-28 11:01:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814424>
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 4285709e-1eb4-5199-8692-2365a9114f52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 3c1070f3-e634-5279-aa25-131d59b68f50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709216%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709216 not downloaded yet
2026-03-28 11:01:37 [bca.uk] INFO: Found listing with ID: MM13%20HZU
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM13%2520HZU%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [bca.uk] INFO: Scrape type for MM13%20HZU: 2
2026-03-28 11:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b4384bea-5574-5b19-ae81-a2e2be52ee8f with identifier: MM13%20HZU
2026-03-28 11:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b4384bea-5574-5b19-ae81-a2e2be52ee8f with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b4384bea-5574-5b19-ae81-a2e2be52ee8f with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b4384bea-5574-5b19-ae81-a2e2be52ee8f, identifier: MM13%20HZU
2026-03-28 11:01:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b4384bea-5574-5b19-ae81-a2e2be52ee8f with identifier: MM13%20HZU
2026-03-28 11:01:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b4384bea-5574-5b19-ae81-a2e2be52ee8f with identifier: MM13%20HZU
2026-03-28 11:01:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b4384bea-5574-5b19-ae81-a2e2be52ee8f with identifier: MM13%20HZU to the API
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM13%20HZU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b4384bea-5574-5b19-ae81-a2e2be52ee8f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM13 HZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM13%20HZU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 53407,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 80 ZETEC Hatchback',
'transmission': 'manual',
'trim': '80 ZETEC',
'vin': 'WF0DXXGAKDDU37049',
'year': 2013}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM13%2520HZU%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [bca.uk] INFO: Saving data for MM13%20HZU: {'auction_closing_time': 1774778400.0, 'created_time': 1774505417.275292, 'last_price_update_time': 1774695697.827178}
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM13%2520HZU') HTTP/1.1" 204 0
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709241%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709241 not downloaded yet
2026-03-28 11:01:37 [bca.uk] INFO: Found listing with ID: MT61%20BJF
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520BJF%27 HTTP/1.1" 200 None
2026-03-28 11:01:37 [bca.uk] INFO: Scrape type for MT61%20BJF: 2
2026-03-28 11:01:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d055250-7708-534d-bfef-f43e1cb68a42 with identifier: MT61%20BJF
2026-03-28 11:01:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7d055250-7708-534d-bfef-f43e1cb68a42 with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7d055250-7708-534d-bfef-f43e1cb68a42 with scrape type 2
2026-03-28 11:01:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7d055250-7708-534d-bfef-f43e1cb68a42, identifier: MT61%20BJF
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaf9e90>
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3e92c795-afee-5372-9d8b-1d752dfd4a43/3e92c795-afee-5372-9d8b-1d752dfd4a43_expert_report_file_3fac3cd1-5acd-4264-9f18-6f95d2d76cfb.pdf HTTP/1.1" 201 0
2026-03-28 11:01:38 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3e92c795-afee-5372-9d8b-1d752dfd4a43
2026-03-28 11:01:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3e92c795-afee-5372-9d8b-1d752dfd4a43, skipping ID generation
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3e92c795-afee-5372-9d8b-1d752dfd4a43
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPX17MBO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX17MBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7d055250-7708-534d-bfef-f43e1cb68a42 with identifier: MT61%20BJF
2026-03-28 11:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7d055250-7708-534d-bfef-f43e1cb68a42 with identifier: MT61%20BJF
2026-03-28 11:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7d055250-7708-534d-bfef-f43e1cb68a42 with identifier: MT61%20BJF to the API
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT61%20BJF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7d055250-7708-534d-bfef-f43e1cb68a42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT61 BJF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT61%20BJF&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'BMW',
'model': '120I',
'odometer': 57155,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW 120I 2.0 ES Coupe',
'transmission': 'manual',
'trim': 'ES',
'vin': 'WBAUC12040VM01966',
'year': 2011}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520BJF%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Saving data for MT61%20BJF: {'auction_closing_time': 1774778400.0, 'created_time': 1774476098.148227, 'last_price_update_time': 1774695698.388794}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT61%2520BJF') HTTP/1.1" 204 0
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709269%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709269 not downloaded yet
2026-03-28 11:01:38 [bca.uk] INFO: Found listing with ID: MT64%20NPP
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520NPP%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Scrape type for MT64%20NPP: 0
2026-03-28 11:01:38 [bca.uk] INFO: Found listing with ID: PJ61%20APK
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ61%2520APK%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Scrape type for PJ61%20APK: 0
2026-03-28 11:01:38 [bca.uk] INFO: Found listing with ID: PK12%20WWH
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK12%2520WWH%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Scrape type for PK12%20WWH: 0
2026-03-28 11:01:38 [bca.uk] INFO: Found listing with ID: PN08%20XDF
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN08%2520XDF%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Scrape type for PN08%20XDF: 0
2026-03-28 11:01:38 [bca.uk] INFO: Found listing with ID: SW14%20OLM
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520OLM%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Scrape type for SW14%20OLM: 0
2026-03-28 11:01:38 [bca.uk] INFO: Found listing with ID: YE63%20SXL
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE63%2520SXL%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Scrape type for YE63%20SXL: 2
2026-03-28 11:01:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 272530ae-8b12-5d5c-8d66-af7e316b6cbc with identifier: YE63%20SXL
2026-03-28 11:01:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 272530ae-8b12-5d5c-8d66-af7e316b6cbc with scrape type 2
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 272530ae-8b12-5d5c-8d66-af7e316b6cbc with scrape type 2
2026-03-28 11:01:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 272530ae-8b12-5d5c-8d66-af7e316b6cbc, identifier: YE63%20SXL
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698600931%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600931 not downloaded yet
2026-03-28 11:01:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 272530ae-8b12-5d5c-8d66-af7e316b6cbc with identifier: YE63%20SXL
2026-03-28 11:01:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 272530ae-8b12-5d5c-8d66-af7e316b6cbc with identifier: YE63%20SXL
2026-03-28 11:01:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 272530ae-8b12-5d5c-8d66-af7e316b6cbc with identifier: YE63%20SXL to the API
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 87,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE63%20SXL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '272530ae-8b12-5d5c-8d66-af7e316b6cbc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE63 SXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE63%20SXL&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'PEUGEOT',
'model': '208',
'odometer': 124038,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.4 E-HDI ACTIVE EGC Hatchback',
'transmission': 'automatic',
'trim': 'E-HDI ACTIVE EGC',
'vin': 'VF3CC8HP0DT130928',
'year': 2013}
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE63%2520SXL%27 HTTP/1.1" 200 None
2026-03-28 11:01:38 [bca.uk] INFO: Saving data for YE63%20SXL: {'auction_closing_time': 1774778400.0, 'created_time': 1774505417.866268, 'last_price_update_time': 1774695698.995642}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE63%2520SXL') HTTP/1.1" 204 0
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698709295%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709295 not downloaded yet
2026-03-28 11:01:39 [bca.uk] INFO: Found listing with ID: YR14%20KPG
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR14%2520KPG%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [bca.uk] INFO: Scrape type for YR14%20KPG: 2
2026-03-28 11:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5583441-8be7-5567-82c4-40966409439f with identifier: YR14%20KPG
2026-03-28 11:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5583441-8be7-5567-82c4-40966409439f with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5583441-8be7-5567-82c4-40966409439f with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5583441-8be7-5567-82c4-40966409439f, identifier: YR14%20KPG
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698600950%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600950 not downloaded yet
2026-03-28 11:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5583441-8be7-5567-82c4-40966409439f with identifier: YR14%20KPG
2026-03-28 11:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5583441-8be7-5567-82c4-40966409439f with identifier: YR14%20KPG
2026-03-28 11:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5583441-8be7-5567-82c4-40966409439f with identifier: YR14%20KPG to the API
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR14%20KPG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f5583441-8be7-5567-82c4-40966409439f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR14 KPG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR14%20KPG&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VOLKSWAGEN',
'model': 'TOUAREG',
'odometer': 156503,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TOUAREG 3.0 V6 TDI 245 R LINE TIP StationWagon',
'transmission': 'manual',
'trim': 'V6 TDI 245 R LINE TIP',
'vin': 'WVGZZZ7PZED049706',
'year': 2014}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR14%2520KPG%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [bca.uk] INFO: Saving data for YR14%20KPG: {'auction_closing_time': 1774778400.0, 'created_time': 1774448975.109772, 'last_price_update_time': 1774695699.537938}
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR14%2520KPG') HTTP/1.1" 204 0
2026-03-28 11:01:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN14XZR/42805338?sv=2020-08-04&st=2026-03-28T11%3A01%3A35Z&se=2026-03-28T11%3A26%3A35Z&sr=b&sp=r&sig=YE5tIpNAnX5DwXvXxzFsUqqgA2Le2hOPivwfPL4%2BZm4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 3c1070f3-e634-5279-aa25-131d59b68f50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:39 [bca.uk] INFO: Found listing with ID: AK15%20EWP
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK15%2520EWP%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [bca.uk] INFO: Scrape type for AK15%20EWP: 0
2026-03-28 11:01:39 [bca.uk] INFO: Found listing with ID: CX16%20CRU
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX16%2520CRU%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [bca.uk] INFO: Scrape type for CX16%20CRU: 0
2026-03-28 11:01:39 [bca.uk] INFO: Found listing with ID: CY62%20HLP
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY62%2520HLP%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [bca.uk] INFO: Scrape type for CY62%20HLP: 2
2026-03-28 11:01:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6af54be1-f534-5d1d-8928-667738f67d78 with identifier: CY62%20HLP
2026-03-28 11:01:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6af54be1-f534-5d1d-8928-667738f67d78 with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6af54be1-f534-5d1d-8928-667738f67d78 with scrape type 2
2026-03-28 11:01:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6af54be1-f534-5d1d-8928-667738f67d78, identifier: CY62%20HLP
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698600970%27 HTTP/1.1" 200 None
2026-03-28 11:01:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600970 not downloaded yet
2026-03-28 11:01:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6af54be1-f534-5d1d-8928-667738f67d78 with identifier: CY62%20HLP
2026-03-28 11:01:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6af54be1-f534-5d1d-8928-667738f67d78 with identifier: CY62%20HLP
2026-03-28 11:01:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6af54be1-f534-5d1d-8928-667738f67d78 with identifier: CY62%20HLP to the API
2026-03-28 11:01:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CY62%20HLP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6af54be1-f534-5d1d-8928-667738f67d78',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CY62 HLP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CY62%20HLP&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 66617,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0JXXGAJJCY28719',
'year': 2012}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY62%2520HLP%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Saving data for CY62%20HLP: {'auction_closing_time': 1774778400.0, 'created_time': 1774476122.175664, 'last_price_update_time': 1774695700.124555}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CY62%2520HLP') HTTP/1.1" 204 0
2026-03-28 11:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709151>
2026-03-28 11:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK11UNU/42807812?sv=2020-08-04&st=2026-03-28T11%3A01%3A39Z&se=2026-03-28T11%3A26%3A39Z&sr=b&sp=r&sig=mMC%2F0QbMt78GOXDWkCTJnBSeXwf2nr%2B3qGuGWnAj8Mw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK11%20UNU-GB>
2026-03-28 11:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709163>
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: DE61%20AOO
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AOO%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for DE61%20AOO: 2
2026-03-28 11:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c8859f2-5f69-5ede-9022-1157d7754e27 with identifier: DE61%20AOO
2026-03-28 11:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c8859f2-5f69-5ede-9022-1157d7754e27 with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c8859f2-5f69-5ede-9022-1157d7754e27 with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c8859f2-5f69-5ede-9022-1157d7754e27, identifier: DE61%20AOO
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698600993%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600993 not downloaded yet
2026-03-28 11:01:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709216/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709216>
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 4285709e-1eb4-5199-8692-2365a9114f52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c8859f2-5f69-5ede-9022-1157d7754e27 with identifier: DE61%20AOO
2026-03-28 11:01:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c8859f2-5f69-5ede-9022-1157d7754e27 with identifier: DE61%20AOO
2026-03-28 11:01:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c8859f2-5f69-5ede-9022-1157d7754e27 with identifier: DE61%20AOO to the API
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE61%20AOO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c8859f2-5f69-5ede-9022-1157d7754e27',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE61 AOO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE61%20AOO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 95777,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNABE311LCT103528',
'year': 2011}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE61%2520AOO%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Saving data for DE61%20AOO: {'auction_closing_time': 1774778400.0, 'created_time': 1774505381.719672, 'last_price_update_time': 1774695700.709405}
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE61%2520AOO') HTTP/1.1" 204 0
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: DV63%20FNX
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV63%2520FNX%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for DV63%20FNX: 0
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: EN60%20NNM
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN60%2520NNM%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for EN60%20NNM: 0
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: EU13%20BPY
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU13%2520BPY%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for EU13%20BPY: 0
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: EX63%20EOA
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX63%2520EOA%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for EX63%20EOA: 0
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: GV09%20SKZ
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV09%2520SKZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for GV09%20SKZ: 0
2026-03-28 11:01:40 [bca.uk] INFO: Found listing with ID: AC58%20KVH
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC58%2520KVH%27 HTTP/1.1" 200 None
2026-03-28 11:01:40 [bca.uk] INFO: Scrape type for AC58%20KVH: 2
2026-03-28 11:01:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20782f6a-0384-5769-82b8-50297a1aba5f with identifier: AC58%20KVH
2026-03-28 11:01:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 20782f6a-0384-5769-82b8-50297a1aba5f with scrape type 2
2026-03-28 11:01:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 20782f6a-0384-5769-82b8-50297a1aba5f with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20782f6a-0384-5769-82b8-50297a1aba5f, identifier: AC58%20KVH
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601010%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601010 not downloaded yet
2026-03-28 11:01:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e823150>
2026-03-28 11:01:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_77d92d9b-9b4d-5625-b538-e4504c499e0f/77d92d9b-9b4d-5625-b538-e4504c499e0f_expert_report_file_21f4fa13-ba06-4011-a075-202dce97eff5.pdf HTTP/1.1" 201 0
2026-03-28 11:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 77d92d9b-9b4d-5625-b538-e4504c499e0f
2026-03-28 11:01:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 77d92d9b-9b4d-5625-b538-e4504c499e0f, skipping ID generation
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 77d92d9b-9b4d-5625-b538-e4504c499e0f
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN14XZR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN14XZR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709269>
2026-03-28 11:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698600931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600931>
2026-03-28 11:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698600907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX17MBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YN64VNE/42807587?sv=2020-08-04&st=2026-03-28T11%3A01%3A40Z&se=2026-03-28T11%3A26%3A40Z&sr=b&sp=r&sig=z%2BNs7KHCYy07aqPfXeZPpjh%2FwyCF0%2Fzt50p5Du2kzFE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YN64%20VNE-GB>
2026-03-28 11:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709190/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709190>
2026-03-28 11:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20782f6a-0384-5769-82b8-50297a1aba5f with identifier: AC58%20KVH
2026-03-28 11:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20782f6a-0384-5769-82b8-50297a1aba5f with identifier: AC58%20KVH
2026-03-28 11:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20782f6a-0384-5769-82b8-50297a1aba5f with identifier: AC58%20KVH to the API
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AC58%20KVH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '20782f6a-0384-5769-82b8-50297a1aba5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AC58 KVH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AC58%20KVH&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'JAGUAR',
'model': 'X-TYPE',
'odometer': 160139,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'JAGUAR X-TYPE 2.2 D SPORT PREMIUM Saloon',
'transmission': 'automatic',
'trim': 'D SPORT PREMIUM',
'vin': 'SAJAG51309BJ55558',
'year': 2009}
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC58%2520KVH%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [bca.uk] INFO: Saving data for AC58%20KVH: {'auction_closing_time': 1774778400.0, 'created_time': 1774304118.968025, 'last_price_update_time': 1774695701.501944}
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AC58%2520KVH') HTTP/1.1" 204 0
2026-03-28 11:01:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698600950/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600950>
2026-03-28 11:01:41 [bca.uk] INFO: Found listing with ID: GY19%20ZXT
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY19%2520ZXT%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [bca.uk] INFO: Scrape type for GY19%20ZXT: 0
2026-03-28 11:01:41 [bca.uk] INFO: Found listing with ID: KM20%20ZZB
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM20%2520ZZB%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [bca.uk] INFO: Scrape type for KM20%20ZZB: 0
2026-03-28 11:01:41 [bca.uk] INFO: Found listing with ID: AB%20181
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB%2520181%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [bca.uk] INFO: Scrape type for AB%20181: 1
2026-03-28 11:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47638edc-537f-518c-a9fe-39dae9b2a79e with identifier: AB%20181
2026-03-28 11:01:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 47638edc-537f-518c-a9fe-39dae9b2a79e
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601037%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601037 not downloaded yet
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660316%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660316 not downloaded yet
2026-03-28 11:01:41 [bca.uk] INFO: Found listing with ID: AO65%20LWK
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520LWK%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [bca.uk] INFO: Scrape type for AO65%20LWK: 2
2026-03-28 11:01:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46 with identifier: AO65%20LWK
2026-03-28 11:01:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46 with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46 with scrape type 2
2026-03-28 11:01:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46, identifier: AO65%20LWK
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601070%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601070 not downloaded yet
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660332%27 HTTP/1.1" 200 None
2026-03-28 11:01:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660332 not downloaded yet
2026-03-28 11:01:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46 with identifier: AO65%20LWK
2026-03-28 11:01:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46 with identifier: AO65%20LWK
2026-03-28 11:01:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0e036d91-a2e1-54e2-8bf1-326fb9fbfb46 with identifier: AO65%20LWK to the API
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO65%20LWK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0e036d91-a2e1-54e2-8bf1-326fb9fbfb46',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO65 LWK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO65%20LWK&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 43689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD SE Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD SE',
'vin': 'SALVA2AN5GH093157',
'year': 2015}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520LWK%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Saving data for AO65%20LWK: {'auction_closing_time': 1774778400.0, 'created_time': 1774476890.042182, 'last_price_update_time': 1774695702.125404}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO65%2520LWK') HTTP/1.1" 204 0
2026-03-28 11:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709295>
2026-03-28 11:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698600970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600970>
2026-03-28 11:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709241>
2026-03-28 11:01:42 [bca.uk] INFO: Found listing with ID: HY15%20PHK
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY15%2520PHK%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Scrape type for HY15%20PHK: 0
2026-03-28 11:01:42 [bca.uk] INFO: Found listing with ID: PN16%20TXY
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN16%2520TXY%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Scrape type for PN16%20TXY: 1
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 747f1e09-43fa-5817-9abd-08df02153dd9 with identifier: PN16%20TXY
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 747f1e09-43fa-5817-9abd-08df02153dd9
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601101%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601101 not downloaded yet
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660356%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660356 not downloaded yet
2026-03-28 11:01:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709176>
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 4285709e-1eb4-5199-8692-2365a9114f52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 3c1070f3-e634-5279-aa25-131d59b68f50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:42 [bca.uk] INFO: Found listing with ID: LC11%20FTF
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520FTF%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Scrape type for LC11%20FTF: 1
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a096844b-591f-5e2c-9e99-d8f67c7bf0ce with identifier: LC11%20FTF
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698601118%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601118 not downloaded yet
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660371%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660371 not downloaded yet
2026-03-28 11:01:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK11UNU/42807812?sv=2020-08-04&st=2026-03-28T11%3A01%3A39Z&se=2026-03-28T11%3A26%3A39Z&sr=b&sp=r&sig=mMC%2F0QbMt78GOXDWkCTJnBSeXwf2nr%2B3qGuGWnAj8Mw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:42 [bca.uk] INFO: Found listing with ID: KD55%20WDG
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD55%2520WDG%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Scrape type for KD55%20WDG: 1
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2e0ea60-9983-5edd-83ac-25374867ce45 with identifier: KD55%20WDG
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a2e0ea60-9983-5edd-83ac-25374867ce45
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660390%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660390 not downloaded yet
2026-03-28 11:01:42 [bca.uk] INFO: Found listing with ID: BD19%20RBF
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520RBF%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Scrape type for BD19%20RBF: 2
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a with identifier: BD19%20RBF
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a, identifier: BD19%20RBF
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660415%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660415 not downloaded yet
2026-03-28 11:01:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a with identifier: BD19%20RBF
2026-03-28 11:01:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a with identifier: BD19%20RBF
2026-03-28 11:01:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a with identifier: BD19%20RBF to the API
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 148,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD19%20RBF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7ad5adbc-4994-5f89-9ec9-f2d8602bcc8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD19 RBF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD19%20RBF&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'AUDI',
'model': 'Q5',
'odometer': 106272,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI Q5 2.0 40 TDI QUATTRO S LINE S-T StationWagon',
'transmission': 'automatic',
'trim': '40 TDI QUATTRO S LINE S-T',
'vin': 'WAUZZZFY6K2010597',
'year': 2019}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520RBF%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Saving data for BD19%20RBF: {'auction_closing_time': 1774864800.0, 'created_time': 1774563905.580388, 'last_price_update_time': 1774695702.906019}
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD19%2520RBF') HTTP/1.1" 204 0
2026-03-28 11:01:42 [bca.uk] INFO: Found listing with ID: CV66%20MDJ
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV66%2520MDJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:42 [bca.uk] INFO: Scrape type for CV66%20MDJ: 2
2026-03-28 11:01:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0ca45cad-a1d0-52d4-884b-3991d45e4480 with identifier: CV66%20MDJ
2026-03-28 11:01:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0ca45cad-a1d0-52d4-884b-3991d45e4480 with scrape type 2
2026-03-28 11:01:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0ca45cad-a1d0-52d4-884b-3991d45e4480 with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0ca45cad-a1d0-52d4-884b-3991d45e4480, identifier: CV66%20MDJ
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660442%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660442 not downloaded yet
2026-03-28 11:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0ca45cad-a1d0-52d4-884b-3991d45e4480 with identifier: CV66%20MDJ
2026-03-28 11:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0ca45cad-a1d0-52d4-884b-3991d45e4480 with identifier: CV66%20MDJ
2026-03-28 11:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0ca45cad-a1d0-52d4-884b-3991d45e4480 with identifier: CV66%20MDJ to the API
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV66%20MDJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0ca45cad-a1d0-52d4-884b-3991d45e4480',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV66 MDJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV66%20MDJ&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'BMW',
'model': 'X1',
'odometer': 67927,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X1 2.0 SDRIVE 18D X LINE STEP StationWagon',
'transmission': 'manual',
'trim': 'SDRIVE 18D X LINE STEP',
'vin': 'WBAHT720605F43582',
'year': 2016}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV66%2520MDJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [bca.uk] INFO: Saving data for CV66%20MDJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774504935.187422, 'last_price_update_time': 1774695703.424918}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV66%2520MDJ') HTTP/1.1" 204 0
2026-03-28 11:01:43 [bca.uk] INFO: Found listing with ID: LA66%20CNU
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520CNU%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [bca.uk] INFO: Scrape type for LA66%20CNU: 2
2026-03-28 11:01:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e4e08df2-46ba-581f-83c7-b45a7cdfbe3b with identifier: LA66%20CNU
2026-03-28 11:01:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e4e08df2-46ba-581f-83c7-b45a7cdfbe3b with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e4e08df2-46ba-581f-83c7-b45a7cdfbe3b with scrape type 2
2026-03-28 11:01:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e4e08df2-46ba-581f-83c7-b45a7cdfbe3b, identifier: LA66%20CNU
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660464%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660464 not downloaded yet
2026-03-28 11:01:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac514050>
2026-03-28 11:01:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b129378e-787d-57af-b4c0-c8af6440f1f9/b129378e-787d-57af-b4c0-c8af6440f1f9_expert_report_file_04c0a7cf-c5cd-4ccb-89cd-0539ecd158f2.pdf HTTP/1.1" 201 0
2026-03-28 11:01:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b129378e-787d-57af-b4c0-c8af6440f1f9
2026-03-28 11:01:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b129378e-787d-57af-b4c0-c8af6440f1f9, skipping ID generation
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b129378e-787d-57af-b4c0-c8af6440f1f9
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBK11UNU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK11UNU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:43 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e4e08df2-46ba-581f-83c7-b45a7cdfbe3b with identifier: LA66%20CNU
2026-03-28 11:01:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e4e08df2-46ba-581f-83c7-b45a7cdfbe3b with identifier: LA66%20CNU
2026-03-28 11:01:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e4e08df2-46ba-581f-83c7-b45a7cdfbe3b with identifier: LA66%20CNU to the API
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA66%20CNU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e4e08df2-46ba-581f-83c7-b45a7cdfbe3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA66 CNU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA66%20CNU&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'BMW',
'model': '118I',
'odometer': 67090,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'SPORT STEP',
'vin': 'WBA1R52040V877109',
'year': 2017}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA66%2520CNU%27 HTTP/1.1" 200 None
2026-03-28 11:01:43 [bca.uk] INFO: Saving data for LA66%20CNU: {'auction_closing_time': 1774864800.0, 'created_time': 1774563908.197728, 'last_price_update_time': 1774695703.969433}
2026-03-28 11:01:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA66%2520CNU') HTTP/1.1" 204 0
2026-03-28 11:01:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YN64VNE/42807587?sv=2020-08-04&st=2026-03-28T11%3A01%3A40Z&se=2026-03-28T11%3A26%3A40Z&sr=b&sp=r&sig=z%2BNs7KHCYy07aqPfXeZPpjh%2FwyCF0%2Fzt50p5Du2kzFE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: SP14%20YXM
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520YXM%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for SP14%20YXM: 2
2026-03-28 11:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a47c5a-e268-500d-a9f6-580658d32329 with identifier: SP14%20YXM
2026-03-28 11:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a47c5a-e268-500d-a9f6-580658d32329 with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73a47c5a-e268-500d-a9f6-580658d32329 with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 73a47c5a-e268-500d-a9f6-580658d32329, identifier: SP14%20YXM
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698660484%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660484 not downloaded yet
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786588%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786588 not downloaded yet
2026-03-28 11:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660316>
2026-03-28 11:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 73a47c5a-e268-500d-a9f6-580658d32329 with identifier: SP14%20YXM
2026-03-28 11:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 73a47c5a-e268-500d-a9f6-580658d32329 with identifier: SP14%20YXM
2026-03-28 11:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 73a47c5a-e268-500d-a9f6-580658d32329 with identifier: SP14%20YXM to the API
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP14%20YXM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '73a47c5a-e268-500d-a9f6-580658d32329',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP14 YXM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP14%20YXM&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 103054,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD PURE (9) Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD PURE (9)',
'vin': 'SALVA2AEXEH939960',
'year': 2014}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520YXM%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Saving data for SP14%20YXM: {'auction_closing_time': 1774864800.0, 'created_time': 1774563909.487674, 'last_price_update_time': 1774695704.512611}
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP14%2520YXM') HTTP/1.1" 204 0
2026-03-28 11:01:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698601037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601037>
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: LM64%20MUY
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM64%2520MUY%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for LM64%20MUY: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: OY14%20RPZ
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY14%2520RPZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for OY14%20RPZ: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: EX13%20SOH
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520SOH%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for EX13%20SOH: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: KU09%20AEA
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU09%2520AEA%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for KU09%20AEA: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: LD10%20VGG
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD10%2520VGG%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for LD10%20VGG: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: PK60%20UOG
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK60%2520UOG%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for PK60%20UOG: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: EN05%20JVE
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN05%2520JVE%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for EN05%20JVE: 0
2026-03-28 11:01:44 [bca.uk] INFO: Found listing with ID: GF13%20WKW
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520WKW%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [bca.uk] INFO: Scrape type for GF13%20WKW: 2
2026-03-28 11:01:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW
2026-03-28 11:01:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e65bf3fb-8cff-53f1-b35d-a5ef723122ba with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e65bf3fb-8cff-53f1-b35d-a5ef723122ba with scrape type 2
2026-03-28 11:01:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e65bf3fb-8cff-53f1-b35d-a5ef723122ba, identifier: GF13%20WKW
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786597%27 HTTP/1.1" 200 None
2026-03-28 11:01:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786597 not downloaded yet
2026-03-28 11:01:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW
2026-03-28 11:01:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW
2026-03-28 11:01:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e65bf3fb-8cff-53f1-b35d-a5ef723122ba with identifier: GF13%20WKW to the API
2026-03-28 11:01:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF13%20WKW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e65bf3fb-8cff-53f1-b35d-a5ef723122ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF13 WKW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF13%20WKW&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 75066,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0DXXGAKDDB35999',
'year': 2013}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520WKW%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [bca.uk] INFO: Saving data for GF13%20WKW: {'auction_closing_time': 1774778400.0, 'created_time': 1774303346.261444, 'last_price_update_time': 1774695705.164733}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF13%2520WKW') HTTP/1.1" 204 0
2026-03-28 11:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660371>
2026-03-28 11:01:45 [bca.uk] INFO: Found listing with ID: GK14%20AYT
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK14%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [bca.uk] INFO: Scrape type for GK14%20AYT: 2
2026-03-28 11:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fc20755f-938c-552b-b574-eb77036dd1fe with identifier: GK14%20AYT
2026-03-28 11:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fc20755f-938c-552b-b574-eb77036dd1fe with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fc20755f-938c-552b-b574-eb77036dd1fe with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fc20755f-938c-552b-b574-eb77036dd1fe, identifier: GK14%20AYT
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786613%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786613 not downloaded yet
2026-03-28 11:01:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb98e50>
2026-03-28 11:01:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5902b6e3-09a1-5300-a4d4-4edd4f8515a9/5902b6e3-09a1-5300-a4d4-4edd4f8515a9_expert_report_file_193d9290-f455-4b41-ab19-7bd99a41f146.pdf HTTP/1.1" 201 0
2026-03-28 11:01:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9
2026-03-28 11:01:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5902b6e3-09a1-5300-a4d4-4edd4f8515a9, skipping ID generation
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYN64VNE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YN64VNE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660415>
2026-03-28 11:01:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660442>
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fc20755f-938c-552b-b574-eb77036dd1fe with identifier: GK14%20AYT
2026-03-28 11:01:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fc20755f-938c-552b-b574-eb77036dd1fe with identifier: GK14%20AYT
2026-03-28 11:01:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fc20755f-938c-552b-b574-eb77036dd1fe with identifier: GK14%20AYT to the API
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK14%20AYT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fc20755f-938c-552b-b574-eb77036dd1fe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK14 AYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK14%20AYT&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FIAT',
'model': '500',
'odometer': 78882,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 LOUNGE S/S Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE S/S',
'vin': 'ZFA3120000J118266',
'year': 2014}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK14%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [bca.uk] INFO: Saving data for GK14%20AYT: {'auction_closing_time': 1774778400.0, 'created_time': 1774476339.30254, 'last_price_update_time': 1774695705.869053}
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK14%2520AYT') HTTP/1.1" 204 0
2026-03-28 11:01:45 [bca.uk] INFO: Found listing with ID: GY09%20BBY
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY09%2520BBY%27 HTTP/1.1" 200 None
2026-03-28 11:01:45 [bca.uk] INFO: Scrape type for GY09%20BBY: 2
2026-03-28 11:01:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07a407b1-5abf-532b-afc3-989c993d7cd3 with identifier: GY09%20BBY
2026-03-28 11:01:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07a407b1-5abf-532b-afc3-989c993d7cd3 with scrape type 2
2026-03-28 11:01:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07a407b1-5abf-532b-afc3-989c993d7cd3 with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07a407b1-5abf-532b-afc3-989c993d7cd3, identifier: GY09%20BBY
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786621%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786621 not downloaded yet
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801700%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801700 not downloaded yet
2026-03-28 11:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660390>
2026-03-28 11:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07a407b1-5abf-532b-afc3-989c993d7cd3 with identifier: GY09%20BBY
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=yellow HTTP/1.1" 200 None
2026-03-28 11:01:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07a407b1-5abf-532b-afc3-989c993d7cd3 with identifier: GY09%20BBY
2026-03-28 11:01:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07a407b1-5abf-532b-afc3-989c993d7cd3 with identifier: GY09%20BBY to the API
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY09%20BBY-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '07a407b1-5abf-532b-afc3-989c993d7cd3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY09 BBY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY09%20BBY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'MINI',
'model': 'COOPER',
'odometer': 92894,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Convertible',
'transmission': 'manual',
'trim': '',
'vin': 'WMWMR32010TX73710',
'year': 2009}
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY09%2520BBY%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Saving data for GY09%20BBY: {'auction_closing_time': 1774778400.0, 'created_time': 1774476330.337487, 'last_price_update_time': 1774695706.617543}
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY09%2520BBY') HTTP/1.1" 204 0
2026-03-28 11:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698601118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601118>
2026-03-28 11:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD55WDG/42807830?sv=2020-08-04&st=2026-03-28T11%3A01%3A45Z&se=2026-03-28T11%3A26%3A45Z&sr=b&sp=r&sig=X3nIglcUeuHUZ%2Fh83axwytxcXEWIU%2F1y7g8E2rKTpLg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KD55%20WDG-GB>
2026-03-28 11:01:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC11FTF/42807829?sv=2020-08-04&st=2026-03-28T11%3A01%3A45Z&se=2026-03-28T11%3A26%3A45Z&sr=b&sp=r&sig=S%2FS1YUh1yyL7uYJIcBHZ6oFvFbHMSoklTbyPjByNjR0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC11%20FTF-GB>
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:46 [bca.uk] INFO: Found listing with ID: HV10%20NKH
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV10%2520NKH%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Scrape type for HV10%20NKH: 0
2026-03-28 11:01:46 [bca.uk] INFO: Found listing with ID: LA54%20FXG
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA54%2520FXG%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Scrape type for LA54%20FXG: 0
2026-03-28 11:01:46 [bca.uk] INFO: Found listing with ID: LR06%20SPZ
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR06%2520SPZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Scrape type for LR06%20SPZ: 0
2026-03-28 11:01:46 [bca.uk] INFO: Found listing with ID: LV13%20FWF
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520FWF%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Scrape type for LV13%20FWF: 0
2026-03-28 11:01:46 [bca.uk] INFO: Found listing with ID: T60%20NJR
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T60%2520NJR%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Scrape type for T60%20NJR: 0
2026-03-28 11:01:46 [bca.uk] INFO: Found listing with ID: WN64%20TLV
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN64%2520TLV%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [bca.uk] INFO: Scrape type for WN64%20TLV: 2
2026-03-28 11:01:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a732533a-85a4-554c-af47-2850242ba100 with identifier: WN64%20TLV
2026-03-28 11:01:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a732533a-85a4-554c-af47-2850242ba100 with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a732533a-85a4-554c-af47-2850242ba100 with scrape type 2
2026-03-28 11:01:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a732533a-85a4-554c-af47-2850242ba100, identifier: WN64%20TLV
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786633%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786633 not downloaded yet
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801720%27 HTTP/1.1" 200 None
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801720 not downloaded yet
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:46 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a732533a-85a4-554c-af47-2850242ba100 with identifier: WN64%20TLV
2026-03-28 11:01:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a732533a-85a4-554c-af47-2850242ba100 with identifier: WN64%20TLV
2026-03-28 11:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a732533a-85a4-554c-af47-2850242ba100 with identifier: WN64%20TLV to the API
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN64%20TLV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a732533a-85a4-554c-af47-2850242ba100',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN64 TLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN64%20TLV&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FIAT',
'model': '500C',
'odometer': 68936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500C 1.2 S Convertible',
'transmission': 'manual',
'trim': 'S',
'vin': 'ZFA3120000J321481',
'year': 2015}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN64%2520TLV%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [bca.uk] INFO: Saving data for WN64%20TLV: {'auction_closing_time': 1774778400.0, 'created_time': 1774505356.103862, 'last_price_update_time': 1774695707.238553}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN64%2520TLV') HTTP/1.1" 204 0
2026-03-28 11:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786588>
2026-03-28 11:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786576/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK11UNU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:47 [bca.uk] INFO: Found listing with ID: DV15%20BDX
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520BDX%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [bca.uk] INFO: Scrape type for DV15%20BDX: 2
2026-03-28 11:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX
2026-03-28 11:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 726fe0cf-79ff-5bd4-8fe1-6749f735c342, identifier: DV15%20BDX
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786648%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786648 not downloaded yet
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801733%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801733 not downloaded yet
2026-03-28 11:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX
2026-03-28 11:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX
2026-03-28 11:01:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 726fe0cf-79ff-5bd4-8fe1-6749f735c342 with identifier: DV15%20BDX to the API
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV15%20BDX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '726fe0cf-79ff-5bd4-8fe1-6749f735c342',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV15 BDX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV15%20BDX&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 130988,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'SJNTAAE12U1106617',
'year': 2015}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520BDX%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [bca.uk] INFO: Saving data for DV15%20BDX: {'auction_closing_time': 1774778400.0, 'created_time': 1774418834.029839, 'last_price_update_time': 1774695707.74302}
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV15%2520BDX') HTTP/1.1" 204 0
2026-03-28 11:01:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786597>
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:47 [bca.uk] INFO: Found listing with ID: NA17%20GMZ
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA17%2520GMZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [bca.uk] INFO: Scrape type for NA17%20GMZ: 2
2026-03-28 11:01:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fbfdc7df-b768-5f72-a3b1-4001cfb50d17 with identifier: NA17%20GMZ
2026-03-28 11:01:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fbfdc7df-b768-5f72-a3b1-4001cfb50d17 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fbfdc7df-b768-5f72-a3b1-4001cfb50d17 with scrape type 2
2026-03-28 11:01:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fbfdc7df-b768-5f72-a3b1-4001cfb50d17, identifier: NA17%20GMZ
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786666%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786666 not downloaded yet
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801749%27 HTTP/1.1" 200 None
2026-03-28 11:01:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801749 not downloaded yet
2026-03-28 11:01:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fbfdc7df-b768-5f72-a3b1-4001cfb50d17 with identifier: NA17%20GMZ
2026-03-28 11:01:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fbfdc7df-b768-5f72-a3b1-4001cfb50d17 with identifier: NA17%20GMZ
2026-03-28 11:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fbfdc7df-b768-5f72-a3b1-4001cfb50d17 with identifier: NA17%20GMZ to the API
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NA17%20GMZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fbfdc7df-b768-5f72-a3b1-4001cfb50d17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA17 GMZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NA17%20GMZ&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MAZDA',
'model': '3',
'odometer': 137421,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MAZDA 3 2.0 165 SPORT Hatchback',
'transmission': 'manual',
'trim': '165 SPORT',
'vin': 'JMZBN647601517451',
'year': 2017}
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA17%2520GMZ%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [bca.uk] INFO: Saving data for NA17%20GMZ: {'auction_closing_time': 1775037600.0, 'created_time': 1774303729.71832, 'last_price_update_time': 1774695708.28691}
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NA17%2520GMZ') HTTP/1.1" 204 0
2026-03-28 11:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801682/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YN64VNE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:48 [bca.uk] INFO: Found listing with ID: YR07%20OWB
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR07%2520OWB%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [bca.uk] INFO: Scrape type for YR07%20OWB: 2
2026-03-28 11:01:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ae293cd-ccc3-5af6-b3a4-d6db64203b02 with identifier: YR07%20OWB
2026-03-28 11:01:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ae293cd-ccc3-5af6-b3a4-d6db64203b02 with scrape type 2
2026-03-28 11:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ae293cd-ccc3-5af6-b3a4-d6db64203b02 with scrape type 2
2026-03-28 11:01:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ae293cd-ccc3-5af6-b3a4-d6db64203b02, identifier: YR07%20OWB
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786690%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786690 not downloaded yet
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801765%27 HTTP/1.1" 200 None
2026-03-28 11:01:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801765 not downloaded yet
2026-03-28 11:01:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786613>
2026-03-28 11:01:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ae293cd-ccc3-5af6-b3a4-d6db64203b02 with identifier: YR07%20OWB
2026-03-28 11:01:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ae293cd-ccc3-5af6-b3a4-d6db64203b02 with identifier: YR07%20OWB
2026-03-28 11:01:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ae293cd-ccc3-5af6-b3a4-d6db64203b02 with identifier: YR07%20OWB to the API
2026-03-28 11:01:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 220,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR07%20OWB-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3ae293cd-ccc3-5af6-b3a4-d6db64203b02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR07 OWB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR07%20OWB&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'SUBARU',
'model': 'FORESTER',
'odometer': 114536,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'SUBARU FORESTER 2.0 XC Estate',
'transmission': 'automatic',
'trim': 'XC',
'vin': 'JF1SG5KE57G089933',
'year': 2007}
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR07%2520OWB%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [bca.uk] INFO: Saving data for YR07%20OWB: {'auction_closing_time': 1774864800.0, 'created_time': 1774563896.773596, 'last_price_update_time': 1774695709.522442}
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR07%2520OWB') HTTP/1.1" 204 0
2026-03-28 11:01:49 [bca.uk] INFO: Found listing with ID: AY61%20ZBP
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY61%2520ZBP%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [bca.uk] INFO: Scrape type for AY61%20ZBP: 0
2026-03-28 11:01:49 [bca.uk] INFO: Found listing with ID: GD12%20LSU
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD12%2520LSU%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [bca.uk] INFO: Scrape type for GD12%20LSU: 0
2026-03-28 11:01:49 [bca.uk] INFO: Found listing with ID: KT09%20JOV
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT09%2520JOV%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [bca.uk] INFO: Scrape type for KT09%20JOV: 0
2026-03-28 11:01:49 [bca.uk] INFO: Found listing with ID: LG61%20YWR
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520YWR%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [bca.uk] INFO: Scrape type for LG61%20YWR: 2
2026-03-28 11:01:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d103450a-4029-5054-b457-fbc3c2232124 with identifier: LG61%20YWR
2026-03-28 11:01:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d103450a-4029-5054-b457-fbc3c2232124 with scrape type 2
2026-03-28 11:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d103450a-4029-5054-b457-fbc3c2232124 with scrape type 2
2026-03-28 11:01:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d103450a-4029-5054-b457-fbc3c2232124, identifier: LG61%20YWR
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786709%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786709 not downloaded yet
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801788%27 HTTP/1.1" 200 None
2026-03-28 11:01:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801788 not downloaded yet
2026-03-28 11:01:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d103450a-4029-5054-b457-fbc3c2232124 with identifier: LG61%20YWR
2026-03-28 11:01:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d103450a-4029-5054-b457-fbc3c2232124 with identifier: LG61%20YWR
2026-03-28 11:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d103450a-4029-5054-b457-fbc3c2232124 with identifier: LG61%20YWR to the API
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG61%20YWR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd103450a-4029-5054-b457-fbc3c2232124',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG61 YWR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG61%20YWR&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 91520,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 1.4 TSI 120 S DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 120 S DSG',
'vin': 'TMBDJ21Z6B2135319',
'year': 2011}
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520YWR%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Saving data for LG61%20YWR: {'auction_closing_time': 1774864800.0, 'created_time': 1774563892.365148, 'last_price_update_time': 1774695710.290339}
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG61%2520YWR') HTTP/1.1" 204 0
2026-03-28 11:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660484>
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: LR53%20YBK
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR53%2520YBK%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for LR53%20YBK: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: LV10%20WSE
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520WSE%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for LV10%20WSE: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: PHZ%206637
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PHZ%25206637%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for PHZ%206637: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: VN09%20WSO
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN09%2520WSO%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for VN09%20WSO: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: KS04%20HEJ
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS04%2520HEJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for KS04%20HEJ: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: LA08%20VDT
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA08%2520VDT%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for LA08%20VDT: 1
2026-03-28 11:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 with identifier: LA08%20VDT
2026-03-28 11:01:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801806%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801806 not downloaded yet
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801700/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801700>
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: KX18%20YOG
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX18%2520YOG%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for KX18%20YOG: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: BF19%20GGJ
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF19%2520GGJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for BF19%20GGJ: 0
2026-03-28 11:01:50 [bca.uk] INFO: Found listing with ID: LP69%20AYT
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP69%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Scrape type for LP69%20AYT: 2
2026-03-28 11:01:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36132587-bc94-516c-88f6-aee5d01d4068 with identifier: LP69%20AYT
2026-03-28 11:01:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36132587-bc94-516c-88f6-aee5d01d4068 with scrape type 2
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36132587-bc94-516c-88f6-aee5d01d4068 with scrape type 2
2026-03-28 11:01:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36132587-bc94-516c-88f6-aee5d01d4068, identifier: LP69%20AYT
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801836%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801836 not downloaded yet
2026-03-28 11:01:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36132587-bc94-516c-88f6-aee5d01d4068 with identifier: LP69%20AYT
2026-03-28 11:01:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36132587-bc94-516c-88f6-aee5d01d4068 with identifier: LP69%20AYT
2026-03-28 11:01:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36132587-bc94-516c-88f6-aee5d01d4068 with identifier: LP69%20AYT to the API
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP69%20AYT-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '36132587-bc94-516c-88f6-aee5d01d4068',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LP69 AYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LP69%20AYT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '520I',
'odometer': 999999,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 520I 2.0 T M SPORT Estate',
'transmission': 'automatic',
'trim': 'T M SPORT',
'vin': 'WBAJT92060BR76394',
'year': 2019}
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP69%2520AYT%27 HTTP/1.1" 200 None
2026-03-28 11:01:50 [bca.uk] INFO: Saving data for LP69%20AYT: {'auction_closing_time': 1774864800.0, 'created_time': 1774477282.380418, 'last_price_update_time': 1774695710.998083}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LP69%2520AYT') HTTP/1.1" 204 0
2026-03-28 11:01:51 [bca.uk] INFO: Found listing with ID: VK21%20OFN
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520OFN%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Scrape type for VK21%20OFN: 0
2026-03-28 11:01:51 [bca.uk] INFO: Found listing with ID: FL18%20SXT
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL18%2520SXT%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Scrape type for FL18%20SXT: 2
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cff17959-676b-540b-ba30-ae8138e6ac20 with identifier: FL18%20SXT
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cff17959-676b-540b-ba30-ae8138e6ac20 with scrape type 2
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cff17959-676b-540b-ba30-ae8138e6ac20 with scrape type 2
2026-03-28 11:01:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cff17959-676b-540b-ba30-ae8138e6ac20, identifier: FL18%20SXT
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801859%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801859 not downloaded yet
2026-03-28 11:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC11FTF/42807829?sv=2020-08-04&st=2026-03-28T11%3A01%3A45Z&se=2026-03-28T11%3A26%3A45Z&sr=b&sp=r&sig=S%2FS1YUh1yyL7uYJIcBHZ6oFvFbHMSoklTbyPjByNjR0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cff17959-676b-540b-ba30-ae8138e6ac20 with identifier: FL18%20SXT
2026-03-28 11:01:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cff17959-676b-540b-ba30-ae8138e6ac20 with identifier: FL18%20SXT
2026-03-28 11:01:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cff17959-676b-540b-ba30-ae8138e6ac20 with identifier: FL18%20SXT to the API
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 93,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL18%20SXT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cff17959-676b-540b-ba30-ae8138e6ac20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL18 SXT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL18%20SXT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 39497,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.6 I-DTEC 120 SE Hatchback',
'transmission': 'manual',
'trim': 'I-DTEC 120 SE',
'vin': 'SHHFK9740JU001483',
'year': 2018}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL18%2520SXT%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Saving data for FL18%20SXT: {'auction_closing_time': 1774778400.0, 'created_time': 1774563824.905298, 'last_price_update_time': 1774695711.688687}
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL18%2520SXT') HTTP/1.1" 204 0
2026-03-28 11:01:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KD55WDG/42807830?sv=2020-08-04&st=2026-03-28T11%3A01%3A45Z&se=2026-03-28T11%3A26%3A45Z&sr=b&sp=r&sig=X3nIglcUeuHUZ%2Fh83axwytxcXEWIU%2F1y7g8E2rKTpLg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:51 [bca.uk] INFO: Found listing with ID: SR68%20WGP
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520WGP%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Scrape type for SR68%20WGP: 1
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7fe48467-9dfd-5dea-af7c-48c104462fe5 with identifier: SR68%20WGP
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7fe48467-9dfd-5dea-af7c-48c104462fe5
2026-03-28 11:01:51 [bca.uk] INFO: Found listing with ID: GU22%20LDF
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU22%2520LDF%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Scrape type for GU22%20LDF: 1
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a865b02-dd0d-5dc9-b937-75342b526486 with identifier: GU22%20LDF
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6a865b02-dd0d-5dc9-b937-75342b526486
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2a850>
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a096844b-591f-5e2c-9e99-d8f67c7bf0ce/a096844b-591f-5e2c-9e99-d8f67c7bf0ce_expert_report_file_096a05ba-3146-41d2-a05a-a873e4b1f2b7.pdf HTTP/1.1" 201 0
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a096844b-591f-5e2c-9e99-d8f67c7bf0ce, skipping ID generation
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC11FTF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC11FTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:51 [bca.uk] INFO: Found listing with ID: RV69%20YEC
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV69%2520YEC%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Scrape type for RV69%20YEC: 1
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b0c9a27-0399-51ae-9584-25135ba8cc28 with identifier: RV69%20YEC
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4b0c9a27-0399-51ae-9584-25135ba8cc28
2026-03-28 11:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801749>
2026-03-28 11:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786648>
2026-03-28 11:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786666/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786666>
2026-03-28 11:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801765>
2026-03-28 11:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786690>
2026-03-28 11:01:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801733/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801733>
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787880%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787880 not downloaded yet
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:51 [bca.uk] INFO: Found listing with ID: CT15%20CRJ
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT15%2520CRJ%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [bca.uk] INFO: Scrape type for CT15%20CRJ: 1
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2edf2a00-6315-583e-ade7-02f61bf18693 with identifier: CT15%20CRJ
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2edf2a00-6315-583e-ade7-02f61bf18693
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf9350>
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2e0ea60-9983-5edd-83ac-25374867ce45/a2e0ea60-9983-5edd-83ac-25374867ce45_expert_report_file_817d5a69-dd72-47bb-8f3a-f694eaa5bb65.pdf HTTP/1.1" 201 0
2026-03-28 11:01:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a2e0ea60-9983-5edd-83ac-25374867ce45
2026-03-28 11:01:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2e0ea60-9983-5edd-83ac-25374867ce45, skipping ID generation
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2e0ea60-9983-5edd-83ac-25374867ce45
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKD55WDG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KD55WDG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787885%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787885 not downloaded yet
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801836>
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801806/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801806>
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801859/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801859>
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA08VDT/42808524?sv=2020-08-04&st=2026-03-28T11%3A01%3A51Z&se=2026-03-28T11%3A26%3A51Z&sr=b&sp=r&sig=rYSajkRDvFGOxuT3gYqcvSmXYf271sZff%2BE3ijYzi4Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA08%20VDT-GB>
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801788>
2026-03-28 11:01:52 [bca.uk] INFO: Found listing with ID: GN64%20WLF
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN64%2520WLF%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [bca.uk] INFO: Scrape type for GN64%20WLF: 0
2026-03-28 11:01:52 [bca.uk] INFO: Found listing with ID: KR67%20KTX
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR67%2520KTX%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [bca.uk] INFO: Scrape type for KR67%20KTX: 0
2026-03-28 11:01:52 [bca.uk] INFO: Found listing with ID: LG62%20CVX
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG62%2520CVX%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [bca.uk] INFO: Scrape type for LG62%20CVX: 1
2026-03-28 11:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24026d87-13ab-5a28-bdb2-a25641ae2e24 with identifier: LG62%20CVX
2026-03-28 11:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 24026d87-13ab-5a28-bdb2-a25641ae2e24
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787856%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787856 not downloaded yet
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787890%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787890 not downloaded yet
2026-03-28 11:01:52 [bca.uk] INFO: Found listing with ID: EK63%20FJV
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520FJV%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [bca.uk] INFO: Scrape type for EK63%20FJV: 0
2026-03-28 11:01:52 [bca.uk] INFO: Found listing with ID: KN57%20WVA
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN57%2520WVA%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [bca.uk] INFO: Scrape type for KN57%20WVA: 1
2026-03-28 11:01:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30676cce-0504-5392-96c7-197b55cc56e8 with identifier: KN57%20WVA
2026-03-28 11:01:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 30676cce-0504-5392-96c7-197b55cc56e8
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787864%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787864 not downloaded yet
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787895%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787895 not downloaded yet
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YN64VNE/698801720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801720>
2026-03-28 11:01:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786709>
2026-03-28 11:01:52 [bca.uk] INFO: Found listing with ID: W838%20AJN
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W838%2520AJN%27 HTTP/1.1" 200 None
2026-03-28 11:01:52 [bca.uk] INFO: Scrape type for W838%20AJN: 1
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:52 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:53 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=2&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787870%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787870 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787900%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787900 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787877%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787877 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787906%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787906 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787882%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787882 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787912%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787912 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787893%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787893 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787918%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787918 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787899%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787899 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787922%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787922 not downloaded yet
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787907%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787907 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787914%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787914 not downloaded yet
2026-03-28 11:01:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LA08VDT/42808524?sv=2020-08-04&st=2026-03-28T11%3A01%3A51Z&se=2026-03-28T11%3A26%3A51Z&sr=b&sp=r&sig=rYSajkRDvFGOxuT3gYqcvSmXYf271sZff%2BE3ijYzi4Y%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb5ae90>
2026-03-28 11:01:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4c013e35-2c0a-59bb-8c74-a78d1dca2b59/4c013e35-2c0a-59bb-8c74-a78d1dca2b59_expert_report_file_48d007a2-34b1-4cf3-8c49-deba8b5f6b58.pdf HTTP/1.1" 201 0
2026-03-28 11:01:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59
2026-03-28 11:01:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4c013e35-2c0a-59bb-8c74-a78d1dca2b59, skipping ID generation
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLA08VDT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LA08VDT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822437%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822437 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822458%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822458 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822480%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822480 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822497%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822497 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822512%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822512 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822531%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822531 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822561%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822561 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822583%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822583 not downloaded yet
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822600%27 HTTP/1.1" 200 None
2026-03-28 11:01:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822600 not downloaded yet
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787864/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787864>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787870>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787895>
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787899>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787907>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787922>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822583>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822600>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787914>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822531>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822561/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822561>
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822512>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822497/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822497>
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822480>
2026-03-28 11:01:54 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822458>
2026-03-28 11:01:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 with identifier: YN64%20VNE
2026-03-28 11:01:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 with identifier: YN64%20VNE
2026-03-28 11:01:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 with identifier: YN64%20VNE to the API
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:55 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 90,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5902b6e3-09a1-5300-a4d4-4edd4f8515a9/5902b6e3-09a1-5300-a4d4-4edd4f8515a9_expert_report_file_193d9290-f455-4b41-ab19-7bd99a41f146.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YN64%20VNE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5902b6e3-09a1-5300-a4d4-4edd4f8515a9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YN64 VNE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YN64%20VNE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 103102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YN64VNE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801700',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801720',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801733',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801749',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801765',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801788',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801806',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801836',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801859'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.5 DCI 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 DYNAMIQUE',
'vin': 'VF15RRL0H51378631',
'year': 2014}
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520VNE%27 HTTP/1.1" 200 None
2026-03-28 11:01:55 [bca.uk] INFO: Saving data for YN64%20VNE: {'created_time': 1774695715.75146, 'last_price_update_time': 1774695715.751475, 'auction_closing_time': 1774951200.0}
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YN64%2520VNE') HTTP/1.1" 204 0
2026-03-28 11:01:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 5902b6e3-09a1-5300-a4d4-4edd4f8515a9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:55 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822437>
2026-03-28 11:01:56 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LA08VDT/698822406/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LA08VDT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787918>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787893/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787893>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787912>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787882>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787906>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787877>
2026-03-28 11:01:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787900>
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:57 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787890>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787856>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787885>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN57WVA/42808050?sv=2020-08-04&st=2026-03-28T11%3A01%3A57Z&se=2026-03-28T11%3A26%3A57Z&sr=b&sp=r&sig=KT%2FNuGr1LWpyhoDmNlX7BwNNYhBY%2Fu1LTDEJ485GWU4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN57%20WVA-GB>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KD55WDG/698787851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KD55WDG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG62CVX/42809604?sv=2020-08-04&st=2026-03-28T11%3A01%3A57Z&se=2026-03-28T11%3A26%3A57Z&sr=b&sp=r&sig=N%2FQ7%2Bi8LjfJdxflZZhHVv%2B2mvQNSL5ttqGEiMGIhSGs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG62%20CVX-GB>
2026-03-28 11:01:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 with identifier: LA08%20VDT
2026-03-28 11:01:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 with identifier: LA08%20VDT
2026-03-28 11:01:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 with identifier: LA08%20VDT to the API
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:01:58 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4c013e35-2c0a-59bb-8c74-a78d1dca2b59/4c013e35-2c0a-59bb-8c74-a78d1dca2b59_expert_report_file_48d007a2-34b1-4cf3-8c49-deba8b5f6b58.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA08%20VDT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4c013e35-2c0a-59bb-8c74-a78d1dca2b59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA08 VDT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA08%20VDT&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MINI',
'model': 'COOPER',
'odometer': 63994,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LA08VDT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822437',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822458',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822480',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822497',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822512',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822531',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822561',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822583',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822600'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'WMWMF72040TT42567',
'year': 2008}
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA08%2520VDT%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [bca.uk] INFO: Saving data for LA08%20VDT: {'created_time': 1774695718.419324, 'last_price_update_time': 1774695718.419336, 'auction_closing_time': 1774778400.0}
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA08%2520VDT') HTTP/1.1" 204 0
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT15CRJ/42789674?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=SH5iooh2EJ3dLSt%2BI%2B6lN3L3%2BKkSZw%2BaRCk9iIR8yNI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CT15%20CRJ-GB>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU22LDF/42808335?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=YPTE15Gl9bL5BdABokbpBr4L7%2ByOhejltc6TSLMaFK4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU22%20LDF-GB>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR68WGP/42809607?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=jFiRcH8ubu9FG4no1vnvPEuQ7ETPUI59KVQ%2B6%2Fp4W1o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR68%20WGP-GB>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786633>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787880/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787880>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV69YEC/42809653?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=L21sUjOGsGG6vCb1docCYDbhySftV0iVTNMItN6vO9I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV69%20YEC-GB>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC11FTF/698787871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC11FTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4c013e35-2c0a-59bb-8c74-a78d1dca2b59 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK11UNU/698786621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786621>
2026-03-28 11:01:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660464>
2026-03-28 11:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KN57WVA/42808050?sv=2020-08-04&st=2026-03-28T11%3A01%3A57Z&se=2026-03-28T11%3A26%3A57Z&sr=b&sp=r&sig=KT%2FNuGr1LWpyhoDmNlX7BwNNYhBY%2Fu1LTDEJ485GWU4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG62CVX/42809604?sv=2020-08-04&st=2026-03-28T11%3A01%3A57Z&se=2026-03-28T11%3A26%3A57Z&sr=b&sp=r&sig=N%2FQ7%2Bi8LjfJdxflZZhHVv%2B2mvQNSL5ttqGEiMGIhSGs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac6c2ad0>
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30676cce-0504-5392-96c7-197b55cc56e8/30676cce-0504-5392-96c7-197b55cc56e8_expert_report_file_1bab36d5-47c7-4852-81f4-71249e9d83a8.pdf HTTP/1.1" 201 0
2026-03-28 11:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 30676cce-0504-5392-96c7-197b55cc56e8
2026-03-28 11:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30676cce-0504-5392-96c7-197b55cc56e8, skipping ID generation
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30676cce-0504-5392-96c7-197b55cc56e8
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKN57WVA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN57WVA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RV69YEC/42809653?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=L21sUjOGsGG6vCb1docCYDbhySftV0iVTNMItN6vO9I%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796098%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796098 not downloaded yet
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796107%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796107 not downloaded yet
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc9410>
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24026d87-13ab-5a28-bdb2-a25641ae2e24/24026d87-13ab-5a28-bdb2-a25641ae2e24_expert_report_file_c696114c-08af-46a1-8daf-54a7c019fcd8.pdf HTTP/1.1" 201 0
2026-03-28 11:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 24026d87-13ab-5a28-bdb2-a25641ae2e24
2026-03-28 11:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24026d87-13ab-5a28-bdb2-a25641ae2e24, skipping ID generation
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24026d87-13ab-5a28-bdb2-a25641ae2e24
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLG62CVX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG62CVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796118%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796118 not downloaded yet
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915244%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915244 not downloaded yet
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796126%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796126 not downloaded yet
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915265%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915265 not downloaded yet
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc9bf90>
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b0c9a27-0399-51ae-9584-25135ba8cc28/4b0c9a27-0399-51ae-9584-25135ba8cc28_expert_report_file_56935cc6-39e7-49a8-8570-6acd02835250.pdf HTTP/1.1" 201 0
2026-03-28 11:01:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4b0c9a27-0399-51ae-9584-25135ba8cc28
2026-03-28 11:01:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b0c9a27-0399-51ae-9584-25135ba8cc28, skipping ID generation
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b0c9a27-0399-51ae-9584-25135ba8cc28
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRV69YEC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RV69YEC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796133%27 HTTP/1.1" 200 None
2026-03-28 11:01:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796133 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915288%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915288 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915276%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915276 not downloaded yet
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796145%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796145 not downloaded yet
2026-03-28 11:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SR68WGP/42809607?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=jFiRcH8ubu9FG4no1vnvPEuQ7ETPUI59KVQ%2B6%2Fp4W1o%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915309%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915309 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915293%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915293 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796155%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796155 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915323%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915323 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915308%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915308 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796162%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796162 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915348%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915348 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915324%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915324 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796173%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796173 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915366%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915366 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915342%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915342 not downloaded yet
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fccad10>
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7fe48467-9dfd-5dea-af7c-48c104462fe5/7fe48467-9dfd-5dea-af7c-48c104462fe5_expert_report_file_7ddfe058-df86-4cac-a712-190a069cd0f4.pdf HTTP/1.1" 201 0
2026-03-28 11:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7fe48467-9dfd-5dea-af7c-48c104462fe5
2026-03-28 11:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7fe48467-9dfd-5dea-af7c-48c104462fe5, skipping ID generation
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7fe48467-9dfd-5dea-af7c-48c104462fe5
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSR68WGP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SR68WGP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915385%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915385 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915364%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915364 not downloaded yet
2026-03-28 11:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU22LDF/42808335?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=YPTE15Gl9bL5BdABokbpBr4L7%2ByOhejltc6TSLMaFK4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915264%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915264 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915408%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915408 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915382%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915382 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915291%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915291 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915402%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915402 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915311%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915311 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915427%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915427 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915335%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915335 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915352%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915352 not downloaded yet
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95ec90>
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:01:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a865b02-dd0d-5dc9-b937-75342b526486/6a865b02-dd0d-5dc9-b937-75342b526486_expert_report_file_274c3aef-6172-4f70-80cf-c0da01aeb21f.pdf HTTP/1.1" 201 0
2026-03-28 11:01:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6a865b02-dd0d-5dc9-b937-75342b526486
2026-03-28 11:01:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a865b02-dd0d-5dc9-b937-75342b526486, skipping ID generation
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a865b02-dd0d-5dc9-b937-75342b526486
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU22LDF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU22LDF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915371%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915371 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813376%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813376 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915390%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915390 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813382%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813382 not downloaded yet
2026-03-28 11:01:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CT15CRJ/42789674?sv=2020-08-04&st=2026-03-28T11%3A01%3A58Z&se=2026-03-28T11%3A26%3A58Z&sr=b&sp=r&sig=SH5iooh2EJ3dLSt%2BI%2B6lN3L3%2BKkSZw%2BaRCk9iIR8yNI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915413%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915413 not downloaded yet
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813394%27 HTTP/1.1" 200 None
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813394 not downloaded yet
2026-03-28 11:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660356>
2026-03-28 11:01:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698601101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601101>
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:59 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:01:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2e0ea60-9983-5edd-83ac-25374867ce45 with identifier: KD55%20WDG
2026-03-28 11:01:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2e0ea60-9983-5edd-83ac-25374867ce45 with identifier: KD55%20WDG
2026-03-28 11:01:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2e0ea60-9983-5edd-83ac-25374867ce45 with identifier: KD55%20WDG to the API
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:01:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2e0ea60-9983-5edd-83ac-25374867ce45/a2e0ea60-9983-5edd-83ac-25374867ce45_expert_report_file_817d5a69-dd72-47bb-8f3a-f694eaa5bb65.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KD55%20WDG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a2e0ea60-9983-5edd-83ac-25374867ce45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KD55 WDG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KD55%20WDG&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'BMW',
'model': '118D',
'odometer': 171689,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KD55WDG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787856',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787864',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787870',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787877',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787882',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787893',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787899',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787907',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787914'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'BMW 118D 2.0 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBAUG32090PY05527',
'year': 2005}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD55%2520WDG%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [bca.uk] INFO: Saving data for KD55%20WDG: {'created_time': 1774695720.091731, 'last_price_update_time': 1774695720.091743, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KD55%2520WDG') HTTP/1.1" 204 0
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698915435%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915435 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813407%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813407 not downloaded yet
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG62CVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796094/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN57WVA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a2e0ea60-9983-5edd-83ac-25374867ce45 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813418%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813418 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813461%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813461 not downloaded yet
2026-03-28 11:02:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fda5610>
2026-03-28 11:02:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2edf2a00-6315-583e-ade7-02f61bf18693/2edf2a00-6315-583e-ade7-02f61bf18693_expert_report_file_59f62aaf-83be-439b-8e45-ce6be131df00.pdf HTTP/1.1" 201 0
2026-03-28 11:02:00 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2edf2a00-6315-583e-ade7-02f61bf18693
2026-03-28 11:02:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2edf2a00-6315-583e-ade7-02f61bf18693, skipping ID generation
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2edf2a00-6315-583e-ade7-02f61bf18693
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCT15CRJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CT15CRJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915335/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915335>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SR68WGP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915427>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796145/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796145>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU22LDF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915352>
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813500%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813500 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885616%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885616 not downloaded yet
2026-03-28 11:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a096844b-591f-5e2c-9e99-d8f67c7bf0ce with identifier: LC11%20FTF
2026-03-28 11:02:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a096844b-591f-5e2c-9e99-d8f67c7bf0ce with identifier: LC11%20FTF
2026-03-28 11:02:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a096844b-591f-5e2c-9e99-d8f67c7bf0ce with identifier: LC11%20FTF to the API
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:00 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a096844b-591f-5e2c-9e99-d8f67c7bf0ce/a096844b-591f-5e2c-9e99-d8f67c7bf0ce_expert_report_file_096a05ba-3146-41d2-a05a-a873e4b1f2b7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC11%20FTF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a096844b-591f-5e2c-9e99-d8f67c7bf0ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC11 FTF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC11%20FTF&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'CHEVROLET',
'model': 'AVEO',
'odometer': 37861,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC11FTF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787880',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787885',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787890',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787895',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787900',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787906',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787912',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787918',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787922'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CHEVROLET AVEO 1.2 LS Hatchback',
'transmission': 'manual',
'trim': 'LS',
'vin': 'KL1SF48DJAB140956',
'year': 2011}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC11%2520FTF%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [bca.uk] INFO: Saving data for LC11%20FTF: {'created_time': 1774695720.671739, 'last_price_update_time': 1774695720.671748, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC11%2520FTF') HTTP/1.1" 204 0
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813531%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813531 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885625%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885625 not downloaded yet
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813376>
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813382>
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item a096844b-591f-5e2c-9e99-d8f67c7bf0ce due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813557%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813557 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885647%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885647 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885657%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885657 not downloaded yet
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885671%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885671 not downloaded yet
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813394/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813394>
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885685%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885685 not downloaded yet
2026-03-28 11:02:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915413>
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885697%27 HTTP/1.1" 200 None
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885697 not downloaded yet
2026-03-28 11:02:00 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b129378e-787d-57af-b4c0-c8af6440f1f9 with identifier: BK11%20UNU
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:02:00 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=brown HTTP/1.1" 200 None
2026-03-28 11:02:01 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:02:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b129378e-787d-57af-b4c0-c8af6440f1f9 with identifier: BK11%20UNU
2026-03-28 11:02:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b129378e-787d-57af-b4c0-c8af6440f1f9 with identifier: BK11%20UNU to the API
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:01 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b129378e-787d-57af-b4c0-c8af6440f1f9/b129378e-787d-57af-b4c0-c8af6440f1f9_expert_report_file_04c0a7cf-c5cd-4ccb-89cd-0539ecd158f2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK11%20UNU-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b129378e-787d-57af-b4c0-c8af6440f1f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK11 UNU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK11%20UNU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 150729,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK11UNU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786588',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786597',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786613',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786621',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786633',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786648',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786666',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786690',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786709'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'RENAULT SCENIC 1.6 VVT 110 DYNAMIQUE TOM TOM MPV',
'transmission': 'manual',
'trim': 'VVT 110 DYNAMIQUE TOM TOM',
'vin': 'VF1JZ1U0644881322',
'year': 2011}
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK11%2520UNU%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [bca.uk] INFO: Saving data for BK11%20UNU: {'created_time': 1774695721.425788, 'last_price_update_time': 1774695721.425802, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK11%2520UNU') HTTP/1.1" 204 0
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697885711%27 HTTP/1.1" 200 None
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885711 not downloaded yet
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item b129378e-787d-57af-b4c0-c8af6440f1f9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813500>
2026-03-28 11:02:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885616>
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:01 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885711>
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885697/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885697>
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885671>
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885685>
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885657/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885657>
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885647>
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885625>
2026-03-28 11:02:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813557>
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:02 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813531>
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CT15CRJ/697885614/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CT15CRJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813461>
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813418/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813418>
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU22LDF/698813407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813407>
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915435>
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915390>
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915371>
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915311/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915311>
2026-03-28 11:02:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915402>
2026-03-28 11:02:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915291>
2026-03-28 11:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915382>
2026-03-28 11:02:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:04 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915408>
2026-03-28 11:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SR68WGP/698915264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915264>
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2edf2a00-6315-583e-ade7-02f61bf18693 with identifier: CT15%20CRJ
2026-03-28 11:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2edf2a00-6315-583e-ade7-02f61bf18693 with identifier: CT15%20CRJ
2026-03-28 11:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2edf2a00-6315-583e-ade7-02f61bf18693 with identifier: CT15%20CRJ to the API
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:05 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2edf2a00-6315-583e-ade7-02f61bf18693/2edf2a00-6315-583e-ade7-02f61bf18693_expert_report_file_59f62aaf-83be-439b-8e45-ce6be131df00.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CT15%20CRJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2edf2a00-6315-583e-ade7-02f61bf18693',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CT15 CRJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CT15%20CRJ&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 61468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CT15CRJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885616',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885625',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885647',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885657',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885671',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885685',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885697',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697885711'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD DYNAMIC (9) Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD DYNAMIC (9)',
'vin': 'SALVA2AE5FH055409',
'year': 2015}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT15%2520CRJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:05 [bca.uk] INFO: Saving data for CT15%20CRJ: {'created_time': 1774695725.428282, 'last_price_update_time': 1774695725.428294, 'auction_closing_time': 1774951200.0}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CT15%2520CRJ') HTTP/1.1" 204 0
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 2edf2a00-6315-583e-ade7-02f61bf18693 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915364/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915364>
2026-03-28 11:02:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6a865b02-dd0d-5dc9-b937-75342b526486 with identifier: GU22%20LDF
2026-03-28 11:02:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6a865b02-dd0d-5dc9-b937-75342b526486 with identifier: GU22%20LDF
2026-03-28 11:02:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6a865b02-dd0d-5dc9-b937-75342b526486 with identifier: GU22%20LDF to the API
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:05 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 41,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a865b02-dd0d-5dc9-b937-75342b526486/6a865b02-dd0d-5dc9-b937-75342b526486_expert_report_file_274c3aef-6172-4f70-80cf-c0da01aeb21f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU22%20LDF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '6a865b02-dd0d-5dc9-b937-75342b526486',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU22 LDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU22%20LDF&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MG MOTOR UK',
'model': 'HS',
'odometer': 66072,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU22LDF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813376',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813382',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813394',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813407',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813418',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813461',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813500',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813531',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813557'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'MG MOTOR UK HS 1.5 T-GDI PHEV EXCITE Hatchback',
'transmission': 'automatic',
'trim': 'T-GDI PHEV EXCITE',
'vin': 'LSJA24395MN216224',
'year': 2022}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU22%2520LDF%27 HTTP/1.1" 200 None
2026-03-28 11:02:05 [bca.uk] INFO: Saving data for GU22%20LDF: {'created_time': 1774695725.94946, 'last_price_update_time': 1774695725.949474, 'auction_closing_time': 1774864800.0}
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU22%2520LDF') HTTP/1.1" 204 0
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915385/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915385>
2026-03-28 11:02:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915342/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915342>
2026-03-28 11:02:05 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 6a865b02-dd0d-5dc9-b937-75342b526486 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796173/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796173>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915324>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915366>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915348/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915348>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796162/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796162>
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915308>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915323/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915323>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796155>
2026-03-28 11:02:06 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915293>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915309>
2026-03-28 11:02:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915276>
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7fe48467-9dfd-5dea-af7c-48c104462fe5 with identifier: SR68%20WGP
2026-03-28 11:02:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7fe48467-9dfd-5dea-af7c-48c104462fe5 with identifier: SR68%20WGP
2026-03-28 11:02:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7fe48467-9dfd-5dea-af7c-48c104462fe5 with identifier: SR68%20WGP to the API
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:07 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7fe48467-9dfd-5dea-af7c-48c104462fe5/7fe48467-9dfd-5dea-af7c-48c104462fe5_expert_report_file_7ddfe058-df86-4cac-a712-190a069cd0f4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR68%20WGP-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7fe48467-9dfd-5dea-af7c-48c104462fe5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR68 WGP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR68%20WGP&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'BMW',
'model': '118I',
'odometer': 44225,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SR68WGP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915264',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915291',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915311',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915335',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915352',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915371',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915390',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915413',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915435'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 M SPORT SHADOW ED. Hatchback',
'transmission': 'manual',
'trim': 'M SPORT SHADOW ED.',
'vin': 'WBA1R520X07B78655',
'year': 2019}
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520WGP%27 HTTP/1.1" 200 None
2026-03-28 11:02:07 [bca.uk] INFO: Saving data for SR68%20WGP: {'created_time': 1774695727.541367, 'last_price_update_time': 1774695727.541378, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR68%2520WGP') HTTP/1.1" 204 0
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 7fe48467-9dfd-5dea-af7c-48c104462fe5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:07 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915288>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796133/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796133>
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RV69YEC/698915249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RV69YEC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796126>
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915265>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG62CVX/698915244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915244>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796118>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796098>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN16TXY/42801890?sv=2020-08-04&st=2026-03-28T11%3A02%3A08Z&se=2026-03-28T11%3A27%3A08Z&sr=b&sp=r&sig=Ig9nLlgxI%2BpPYVJQm091kFQ2ZMTPt5Q0fFLqYLThMxU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN16%20TXY-GB>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN57WVA/698796107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796107>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660332>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698601070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601070>
2026-03-28 11:02:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AB181/42802514?sv=2020-08-04&st=2026-03-28T11%3A02%3A08Z&se=2026-03-28T11%3A27%3A08Z&sr=b&sp=r&sig=fiAsSOiUlQHHGAVSnvkfpFRNwfRwAyeqB7fVZfTU%2FEk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AB%20181-GB>
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:08 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:09 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:09 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b0c9a27-0399-51ae-9584-25135ba8cc28 with identifier: RV69%20YEC
2026-03-28 11:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b0c9a27-0399-51ae-9584-25135ba8cc28 with identifier: RV69%20YEC
2026-03-28 11:02:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b0c9a27-0399-51ae-9584-25135ba8cc28 with identifier: RV69%20YEC to the API
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:09 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b0c9a27-0399-51ae-9584-25135ba8cc28/4b0c9a27-0399-51ae-9584-25135ba8cc28_expert_report_file_56935cc6-39e7-49a8-8570-6acd02835250.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV69%20YEC-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4b0c9a27-0399-51ae-9584-25135ba8cc28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV69 YEC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV69%20YEC&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 15584,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RV69YEC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915276',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915293',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915308',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915324',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915342',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915364',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915382',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915402',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915427'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 VVT-I ICON TECH Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I ICON TECH',
'vin': 'VNKKG3D360A167099',
'year': 2019}
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV69%2520YEC%27 HTTP/1.1" 200 None
2026-03-28 11:02:09 [bca.uk] INFO: Saving data for RV69%20YEC: {'created_time': 1774695729.855377, 'last_price_update_time': 1774695729.855389, 'auction_closing_time': 1774864800.0}
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV69%2520YEC') HTTP/1.1" 204 0
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 4b0c9a27-0399-51ae-9584-25135ba8cc28 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN16TXY/42801890?sv=2020-08-04&st=2026-03-28T11%3A02%3A08Z&se=2026-03-28T11%3A27%3A08Z&sr=b&sp=r&sig=Ig9nLlgxI%2BpPYVJQm091kFQ2ZMTPt5Q0fFLqYLThMxU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:09 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AB181/42802514?sv=2020-08-04&st=2026-03-28T11%3A02%3A08Z&se=2026-03-28T11%3A27%3A08Z&sr=b&sp=r&sig=fiAsSOiUlQHHGAVSnvkfpFRNwfRwAyeqB7fVZfTU%2FEk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24026d87-13ab-5a28-bdb2-a25641ae2e24 with identifier: LG62%20CVX
2026-03-28 11:02:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24026d87-13ab-5a28-bdb2-a25641ae2e24 with identifier: LG62%20CVX
2026-03-28 11:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24026d87-13ab-5a28-bdb2-a25641ae2e24 with identifier: LG62%20CVX to the API
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:10 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24026d87-13ab-5a28-bdb2-a25641ae2e24/24026d87-13ab-5a28-bdb2-a25641ae2e24_expert_report_file_c696114c-08af-46a1-8daf-54a7c019fcd8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG62%20CVX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '24026d87-13ab-5a28-bdb2-a25641ae2e24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG62 CVX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG62%20CVX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 48549,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG62CVX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915244',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915265',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915288',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915309',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915323',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915348',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915366',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915385',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915408'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.2 SD4 4WD PRESTIGE Hatchback',
'transmission': 'automatic',
'trim': 'SD4 4WD PRESTIGE',
'vin': 'SALVA2AE8DH706710',
'year': 2012}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG62%2520CVX%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [bca.uk] INFO: Saving data for LG62%20CVX: {'created_time': 1774695730.400422, 'last_price_update_time': 1774695730.400436, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG62%2520CVX') HTTP/1.1" 204 0
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709140/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709140>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698600993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600993>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX17MBO/698601010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601010>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KN14XZR/698660297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN14XZR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:10 [scrapy.extensions.logstats] INFO: Crawled 34 pages (at 33 pages/min), scraped 60 items (at 60 items/min)
2026-03-28 11:02:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 176MiB
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 24026d87-13ab-5a28-bdb2-a25641ae2e24 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e982050>
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_747f1e09-43fa-5817-9abd-08df02153dd9/747f1e09-43fa-5817-9abd-08df02153dd9_expert_report_file_fcc38b19-ddf3-44f2-af0f-58d5bbfa21eb.pdf HTTP/1.1" 201 0
2026-03-28 11:02:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 747f1e09-43fa-5817-9abd-08df02153dd9
2026-03-28 11:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 747f1e09-43fa-5817-9abd-08df02153dd9, skipping ID generation
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 747f1e09-43fa-5817-9abd-08df02153dd9
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPN16TXY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN16TXY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd39710>
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_47638edc-537f-518c-a9fe-39dae9b2a79e/47638edc-537f-518c-a9fe-39dae9b2a79e_expert_report_file_c3cc80d7-a59a-4e53-b03b-7483a7d0547b.pdf HTTP/1.1" 201 0
2026-03-28 11:02:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 47638edc-537f-518c-a9fe-39dae9b2a79e
2026-03-28 11:02:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 47638edc-537f-518c-a9fe-39dae9b2a79e, skipping ID generation
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 47638edc-537f-518c-a9fe-39dae9b2a79e
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAB181-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AB181-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF16UTG/698709128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF16UTG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818408>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802762>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802769>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915749>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798708>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818479>
2026-03-28 11:02:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787559/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787559>
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698623419%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623419 not downloaded yet
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698608860%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608860 not downloaded yet
2026-03-28 11:02:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30676cce-0504-5392-96c7-197b55cc56e8 with identifier: KN57%20WVA
2026-03-28 11:02:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30676cce-0504-5392-96c7-197b55cc56e8 with identifier: KN57%20WVA
2026-03-28 11:02:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30676cce-0504-5392-96c7-197b55cc56e8 with identifier: KN57%20WVA to the API
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:10 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30676cce-0504-5392-96c7-197b55cc56e8/30676cce-0504-5392-96c7-197b55cc56e8_expert_report_file_1bab36d5-47c7-4852-81f4-71249e9d83a8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN57%20WVA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '30676cce-0504-5392-96c7-197b55cc56e8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN57 WVA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN57%20WVA&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 130665,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN57WVA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796098',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796107',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796118',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796126',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796133',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796145',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796155',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796162',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796173'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE',
'vin': 'LUCGE375073212505',
'year': 2007}
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN57%2520WVA%27 HTTP/1.1" 200 None
2026-03-28 11:02:10 [bca.uk] INFO: Saving data for KN57%20WVA: {'created_time': 1774695730.992334, 'last_price_update_time': 1774695730.992392, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN57%2520WVA') HTTP/1.1" 204 0
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698531878%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531878 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559334%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559334 not downloaded yet
2026-03-28 11:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU13OVD/42807043?sv=2020-08-04&st=2026-03-28T11%3A02%3A10Z&se=2026-03-28T11%3A27%3A10Z&sr=b&sp=r&sig=67A6MNhM57LGoKYmfKj49b7HIOh0AtXbL0k5WBhz%2FTA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU13%20OVD-GB>
2026-03-28 11:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798698/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798698>
2026-03-28 11:02:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798663>
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 30676cce-0504-5392-96c7-197b55cc56e8 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698623444%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623444 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698608870%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608870 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698531888%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531888 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559338%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559338 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698623461%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623461 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698608881%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608881 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698531898%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531898 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559341%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559341 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698623473%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623473 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698608890%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608890 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698531906%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531906 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698559346%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559346 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698623490%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623490 not downloaded yet
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698608909%27 HTTP/1.1" 200 None
2026-03-28 11:02:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608909 not downloaded yet
2026-03-28 11:02:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3e92c795-afee-5372-9d8b-1d752dfd4a43 with identifier: PX17%20MBO
2026-03-28 11:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3e92c795-afee-5372-9d8b-1d752dfd4a43 with identifier: PX17%20MBO
2026-03-28 11:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3e92c795-afee-5372-9d8b-1d752dfd4a43 with identifier: PX17%20MBO to the API
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:12 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3e92c795-afee-5372-9d8b-1d752dfd4a43/3e92c795-afee-5372-9d8b-1d752dfd4a43_expert_report_file_3fac3cd1-5acd-4264-9f18-6f95d2d76cfb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX17%20MBO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3e92c795-afee-5372-9d8b-1d752dfd4a43',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX17 MBO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX17%20MBO&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'MINI',
'model': 'COOPER',
'odometer': 28880,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX17MBO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600931',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600950',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600970',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698600993',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601010',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601037',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601070',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601101',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698601118'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.5 136 Hatchback',
'transmission': 'manual',
'trim': '136',
'vin': 'WMWXM520X02F68385',
'year': 2017}
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX17%2520MBO%27 HTTP/1.1" 200 None
2026-03-28 11:02:12 [bca.uk] INFO: Saving data for PX17%20MBO: {'created_time': 1774695732.752619, 'last_price_update_time': 1774695732.752632, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX17%2520MBO') HTTP/1.1" 204 0
2026-03-28 11:02:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698608909/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608909>
2026-03-28 11:02:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:12 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77d92d9b-9b4d-5625-b538-e4504c499e0f with identifier: KN14%20XZR
2026-03-28 11:02:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77d92d9b-9b4d-5625-b538-e4504c499e0f with identifier: KN14%20XZR
2026-03-28 11:02:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77d92d9b-9b4d-5625-b538-e4504c499e0f with identifier: KN14%20XZR to the API
2026-03-28 11:02:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:13 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_77d92d9b-9b4d-5625-b538-e4504c499e0f/77d92d9b-9b4d-5625-b538-e4504c499e0f_expert_report_file_21f4fa13-ba06-4011-a075-202dce97eff5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN14%20XZR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '77d92d9b-9b4d-5625-b538-e4504c499e0f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN14 XZR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN14%20XZR&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 83671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KN14XZR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660316',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660332',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660356',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660371',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660390',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660415',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660442',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660464',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698660484'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.5 DCI 90 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 ACENTA PREMIUM',
'vin': 'SJNTCAE12U1026444',
'year': 2014}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN14%2520XZR%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [bca.uk] INFO: Saving data for KN14%20XZR: {'created_time': 1774695733.158173, 'last_price_update_time': 1774695733.158183, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN14%2520XZR') HTTP/1.1" 204 0
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 3e92c795-afee-5372-9d8b-1d752dfd4a43 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 77d92d9b-9b4d-5625-b538-e4504c499e0f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VU13OVD/42807043?sv=2020-08-04&st=2026-03-28T11%3A02%3A10Z&se=2026-03-28T11%3A27%3A10Z&sr=b&sp=r&sig=67A6MNhM57LGoKYmfKj49b7HIOh0AtXbL0k5WBhz%2FTA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698623490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623490>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698559346/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559346>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698559341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559341>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698531906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531906>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698623473/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623473>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698531898/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531898>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698608890/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608890>
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 408cf7cd-5c88-5b19-ae14-d015866edb29 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 4285709e-1eb4-5199-8692-2365a9114f52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 50d5ecca-764d-50fb-be83-8ecebd8cb459 with identifier: MF16%20UTG
2026-03-28 11:02:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 50d5ecca-764d-50fb-be83-8ecebd8cb459 with identifier: MF16%20UTG
2026-03-28 11:02:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 50d5ecca-764d-50fb-be83-8ecebd8cb459 with identifier: MF16%20UTG to the API
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:13 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_50d5ecca-764d-50fb-be83-8ecebd8cb459/50d5ecca-764d-50fb-be83-8ecebd8cb459_expert_report_file_dceed780-0ddd-4a84-97b7-0e2051555885.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF16%20UTG-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '50d5ecca-764d-50fb-be83-8ecebd8cb459',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF16 UTG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF16%20UTG&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'FORD',
'model': 'KA',
'odometer': 27793,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF16UTG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709140',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709151',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709163',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709176',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709190',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709216',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709241',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709269',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698709295'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 ZETEC BLACK EDITION Hatchback',
'transmission': 'manual',
'trim': 'ZETEC BLACK EDITION',
'vin': 'WF0UXXLTRUFJ69476',
'year': 2016}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520UTG%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [bca.uk] INFO: Saving data for MF16%20UTG: {'created_time': 1774695733.670395, 'last_price_update_time': 1774695733.670408, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF16%2520UTG') HTTP/1.1" 204 0
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698623461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623461>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698559338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559338>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698608870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608870>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698608881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608881>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698623444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623444>
2026-03-28 11:02:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698531888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531888>
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 50d5ecca-764d-50fb-be83-8ecebd8cb459 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea55090>
2026-03-28 11:02:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af585fe7-11dd-51ed-a3c0-f086e4921a87/af585fe7-11dd-51ed-a3c0-f086e4921a87_expert_report_file_788c9e2e-99f9-4420-9339-094555fe5675.pdf HTTP/1.1" 201 0
2026-03-28 11:02:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item af585fe7-11dd-51ed-a3c0-f086e4921a87
2026-03-28 11:02:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af585fe7-11dd-51ed-a3c0-f086e4921a87, skipping ID generation
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af585fe7-11dd-51ed-a3c0-f086e4921a87
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVU13OVD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VU13OVD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809513%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809513 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809529%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809529 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809545%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809545 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809556%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809556 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809567%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809567 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809590%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809590 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809604%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809604 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809622%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809622 not downloaded yet
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809639%27 HTTP/1.1" 200 None
2026-03-28 11:02:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809639 not downloaded yet
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809639>
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809622>
2026-03-28 11:02:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809604>
2026-03-28 11:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809590>
2026-03-28 11:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809567>
2026-03-28 11:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809556>
2026-03-28 11:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809545>
2026-03-28 11:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809529>
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809513>
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:15 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698559334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559334>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VU13OVD/698809497/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VU13OVD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698531878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531878>
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698608860/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608860>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698623419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623419>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AB181/698608851/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AB181-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN16TXY/698623399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN16TXY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814390>
2026-03-28 11:02:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787544>
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:16 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 3 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:17 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:02:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af585fe7-11dd-51ed-a3c0-f086e4921a87 with identifier: VU13%20OVD
2026-03-28 11:02:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af585fe7-11dd-51ed-a3c0-f086e4921a87 with identifier: VU13%20OVD
2026-03-28 11:02:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af585fe7-11dd-51ed-a3c0-f086e4921a87 with identifier: VU13%20OVD to the API
2026-03-28 11:02:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:18 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af585fe7-11dd-51ed-a3c0-f086e4921a87/af585fe7-11dd-51ed-a3c0-f086e4921a87_expert_report_file_788c9e2e-99f9-4420-9339-094555fe5675.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU13%20OVD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af585fe7-11dd-51ed-a3c0-f086e4921a87',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VU13 OVD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VU13%20OVD&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 54641,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VU13OVD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809513',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809529',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809545',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809556',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809567',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809590',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809604',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809622',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809639'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 VVT LTD.EDITION Hatchback',
'transmission': 'manual',
'trim': 'VVT LTD.EDITION',
'vin': 'W0L0SDL08D6045098',
'year': 2013}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU13%2520OVD%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [bca.uk] INFO: Saving data for VU13%20OVD: {'created_time': 1774695738.136852, 'last_price_update_time': 1774695738.136865, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VU13%2520OVD') HTTP/1.1" 204 0
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802754>
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item af585fe7-11dd-51ed-a3c0-f086e4921a87 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:18 [bca.uk] INFO: Total items found: 100
2026-03-28 11:02:18 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded
2026-03-28 11:02:18 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:02:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:18 [bca.uk] INFO: Found listing with ID: EK63%20UCX
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520UCX%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [bca.uk] INFO: Scrape type for EK63%20UCX: 2
2026-03-28 11:02:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6d03878-51dc-5558-8618-8598aecb3b5e with identifier: EK63%20UCX
2026-03-28 11:02:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d6d03878-51dc-5558-8618-8598aecb3b5e with scrape type 2
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d6d03878-51dc-5558-8618-8598aecb3b5e with scrape type 2
2026-03-28 11:02:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d6d03878-51dc-5558-8618-8598aecb3b5e, identifier: EK63%20UCX
2026-03-28 11:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d6d03878-51dc-5558-8618-8598aecb3b5e with identifier: EK63%20UCX
2026-03-28 11:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d6d03878-51dc-5558-8618-8598aecb3b5e with identifier: EK63%20UCX
2026-03-28 11:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d6d03878-51dc-5558-8618-8598aecb3b5e with identifier: EK63%20UCX to the API
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK63%20UCX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd6d03878-51dc-5558-8618-8598aecb3b5e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK63 UCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK63%20UCX&vehicleType=*',
'listing': 'auction',
'location': 'Paddock Wood',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 62119,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.6 COOPER S Hatchback',
'transmission': 'automatic',
'trim': 'COOPER S',
'vin': 'WMWZC32010WR77557',
'year': 2013}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520UCX%27 HTTP/1.1" 200 None
2026-03-28 11:02:18 [bca.uk] INFO: Saving data for EK63%20UCX: {'auction_closing_time': 1774864800.0, 'created_time': 1774563880.560711, 'last_price_update_time': 1774695738.643978}
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK63%2520UCX') HTTP/1.1" 204 0
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818462/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818462>
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802766/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802766>
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915724>
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915743>
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798729>
2026-03-28 11:02:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802746/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802746>
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 2 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:18 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47638edc-537f-518c-a9fe-39dae9b2a79e with identifier: AB%20181
2026-03-28 11:02:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47638edc-537f-518c-a9fe-39dae9b2a79e with identifier: AB%20181
2026-03-28 11:02:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47638edc-537f-518c-a9fe-39dae9b2a79e with identifier: AB%20181 to the API
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_47638edc-537f-518c-a9fe-39dae9b2a79e/47638edc-537f-518c-a9fe-39dae9b2a79e_expert_report_file_c3cc80d7-a59a-4e53-b03b-7483a7d0547b.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AB%20181-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47638edc-537f-518c-a9fe-39dae9b2a79e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AB 181',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AB%20181&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'HYUNDAI',
'model': 'IX20',
'odometer': 20411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AB181-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608860',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559334',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608870',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559338',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608881',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559341',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608890',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698559346',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698608909'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'HYUNDAI IX20 1.6 SE MPV',
'transmission': 'automatic',
'trim': 'SE',
'vin': 'TMAPU81DMHJ254954',
'year': 2017}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB%2520181%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [bca.uk] INFO: Saving data for AB%20181: {'created_time': 1774695739.077076, 'last_price_update_time': 1774695739.077088, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AB%2520181') HTTP/1.1" 204 0
2026-03-28 11:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 747f1e09-43fa-5817-9abd-08df02153dd9 with identifier: PN16%20TXY
2026-03-28 11:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 747f1e09-43fa-5817-9abd-08df02153dd9 with identifier: PN16%20TXY
2026-03-28 11:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 747f1e09-43fa-5817-9abd-08df02153dd9 with identifier: PN16%20TXY to the API
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:19 [scrapy.core.scraper] DEBUG: Scraped from Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_747f1e09-43fa-5817-9abd-08df02153dd9/747f1e09-43fa-5817-9abd-08df02153dd9_expert_report_file_fcc38b19-ddf3-44f2-af0f-58d5bbfa21eb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN16%20TXY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '747f1e09-43fa-5817-9abd-08df02153dd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN16 TXY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN16%20TXY&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'CITROEN',
'model': 'C1',
'odometer': 37600,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photo_urls': ['https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN16TXY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623419',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531878',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623444',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531888',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623461',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531898',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623473',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698531906',
'https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698623490'],
'photos': [],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.2 P/T 82 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FLAIR',
'vin': 'VF7PAHMTCFR776655',
'year': 2016}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN16%2520TXY%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [bca.uk] INFO: Saving data for PN16%20TXY: {'created_time': 1774695739.456708, 'last_price_update_time': 1774695739.45672, 'auction_closing_time': 1774778400.0}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN16%2520TXY') HTTP/1.1" 204 0
2026-03-28 11:02:19 [bca.uk] INFO: Found listing with ID: HG18%20UAP
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG18%2520UAP%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [bca.uk] INFO: Scrape type for HG18%20UAP: 0
2026-03-28 11:02:19 [bca.uk] INFO: Found listing with ID: BX69%20KFJ
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX69%2520KFJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [bca.uk] INFO: Scrape type for BX69%20KFJ: 0
2026-03-28 11:02:19 [bca.uk] INFO: Found listing with ID: GU68%20KAX
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520KAX%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [bca.uk] INFO: Scrape type for GU68%20KAX: 2
2026-03-28 11:02:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2c2762b-2f32-5cd1-95cd-05fb879c1367 with identifier: GU68%20KAX
2026-03-28 11:02:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f2c2762b-2f32-5cd1-95cd-05fb879c1367 with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f2c2762b-2f32-5cd1-95cd-05fb879c1367 with scrape type 2
2026-03-28 11:02:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f2c2762b-2f32-5cd1-95cd-05fb879c1367, identifier: GU68%20KAX
2026-03-28 11:02:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 47638edc-537f-518c-a9fe-39dae9b2a79e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:19 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 0 for item 747f1e09-43fa-5817-9abd-08df02153dd9 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:19 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f2c2762b-2f32-5cd1-95cd-05fb879c1367 with identifier: GU68%20KAX
2026-03-28 11:02:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f2c2762b-2f32-5cd1-95cd-05fb879c1367 with identifier: GU68%20KAX
2026-03-28 11:02:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f2c2762b-2f32-5cd1-95cd-05fb879c1367 with identifier: GU68%20KAX to the API
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU68%20KAX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f2c2762b-2f32-5cd1-95cd-05fb879c1367',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU68 KAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU68%20KAX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 80009,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.0 VTEC TURBO 129 EX Hatchback',
'transmission': 'manual',
'trim': 'VTEC TURBO 129 EX',
'vin': 'SHHFK6780HU020567',
'year': 2018}
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520KAX%27 HTTP/1.1" 200 None
2026-03-28 11:02:19 [bca.uk] INFO: Saving data for GU68%20KAX: {'auction_closing_time': 1774864800.0, 'created_time': 1774361895.535372, 'last_price_update_time': 1774695739.99352}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU68%2520KAX') HTTP/1.1" 204 0
2026-03-28 11:02:20 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: LJ68%20YWE
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ68%2520YWE%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for LJ68%20YWE: 0
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: SC71%20KXX
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC71%2520KXX%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for SC71%20KXX: 0
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: SP19%20KZX
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP19%2520KZX%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for SP19%20KZX: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814352>
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818395>
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798685>
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798692>
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798658>
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802735/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802735>
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787517>
2026-03-28 11:02:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item 3c1070f3-e634-5279-aa25-131d59b68f50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:20 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 5 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: YK69%20PZB
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK69%2520PZB%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for YK69%20PZB: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: AB55%20WWW
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AB55%2520WWW%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for AB55%20WWW: 0
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: WN68%20XXC
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN68%2520XXC%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for WN68%20XXC: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80b8c73c-e33d-5f05-b1b8-6f3101793112 with identifier: WN68%20XXC
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: PX72%20KYH
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX72%2520KYH%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for PX72%20KYH: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: FD18%20SVU
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520SVU%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for FD18%20SVU: 2
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0d6ccaf-ebae-5550-a782-b07578461981 with identifier: FD18%20SVU
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0d6ccaf-ebae-5550-a782-b07578461981 with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0d6ccaf-ebae-5550-a782-b07578461981 with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f0d6ccaf-ebae-5550-a782-b07578461981, identifier: FD18%20SVU
2026-03-28 11:02:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f0d6ccaf-ebae-5550-a782-b07578461981 with identifier: FD18%20SVU
2026-03-28 11:02:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f0d6ccaf-ebae-5550-a782-b07578461981 with identifier: FD18%20SVU
2026-03-28 11:02:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f0d6ccaf-ebae-5550-a782-b07578461981 with identifier: FD18%20SVU to the API
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD18%20SVU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f0d6ccaf-ebae-5550-a782-b07578461981',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD18 SVU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD18%20SVU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'KIA',
'model': 'STONIC',
'odometer': 41994,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'KIA STONIC 1.0 T GDI 120 2 Hatchback',
'transmission': 'manual',
'trim': 'T GDI 120 2',
'vin': 'KNAD6811LJ6170346',
'year': 2018}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520SVU%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Saving data for FD18%20SVU: {'auction_closing_time': 1774778400.0, 'created_time': 1774339551.373561, 'last_price_update_time': 1774695740.639688}
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD18%2520SVU') HTTP/1.1" 204 0
2026-03-28 11:02:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818438/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818438>
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: NK17%20UZV
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK17%2520UZV%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for NK17%20UZV: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: NU67%20AWA
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU67%2520AWA%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for NU67%20AWA: 0
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: AE06%20HAU
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE06%2520HAU%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for AE06%20HAU: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: EA08%20SVO
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA08%2520SVO%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for EA08%20SVO: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 635e2677-2002-50d0-a57a-a285b9386cd8 with identifier: EA08%20SVO
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: GU09%20BHP
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520BHP%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for GU09%20BHP: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7cf4ba2-074e-565a-8e3d-b27be7a9586a with identifier: GU09%20BHP
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: SL07%20BVB
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL07%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for SL07%20BVB: 1
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 965bc451-0889-5f8d-976c-d99f3e039949 with identifier: SL07%20BVB
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: FG67%20NYZ
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG67%2520NYZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for FG67%20NYZ: 0
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: J22%20CDN
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J22%2520CDN%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for J22%20CDN: 0
2026-03-28 11:02:20 [bca.uk] INFO: Found listing with ID: LD64%20UCP
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520UCP%27 HTTP/1.1" 200 None
2026-03-28 11:02:20 [bca.uk] INFO: Scrape type for LD64%20UCP: 2
2026-03-28 11:02:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02f3d3c-c369-5bb0-961a-8b18ba5a8d06 with identifier: LD64%20UCP
2026-03-28 11:02:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02f3d3c-c369-5bb0-961a-8b18ba5a8d06 with scrape type 2
2026-03-28 11:02:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02f3d3c-c369-5bb0-961a-8b18ba5a8d06 with scrape type 2
2026-03-28 11:02:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f02f3d3c-c369-5bb0-961a-8b18ba5a8d06, identifier: LD64%20UCP
2026-03-28 11:02:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f02f3d3c-c369-5bb0-961a-8b18ba5a8d06 with identifier: LD64%20UCP
2026-03-28 11:02:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f02f3d3c-c369-5bb0-961a-8b18ba5a8d06 with identifier: LD64%20UCP
2026-03-28 11:02:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f02f3d3c-c369-5bb0-961a-8b18ba5a8d06 with identifier: LD64%20UCP to the API
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD64%20UCP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f02f3d3c-c369-5bb0-961a-8b18ba5a8d06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD64 UCP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD64%20UCP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 67309,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0DXXGAKDEA36794',
'year': 2014}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD64%2520UCP%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Saving data for LD64%20UCP: {'auction_closing_time': 1774778400.0, 'created_time': 1774564481.421498, 'last_price_update_time': 1774695741.385001}
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD64%2520UCP') HTTP/1.1" 204 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: MA14%20ZKB
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA14%2520ZKB%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for MA14%20ZKB: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: MJ18%20VDO
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520VDO%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for MJ18%20VDO: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: AP15%20JHV
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP15%2520JHV%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for AP15%20JHV: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: BT16%20TPO
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT16%2520TPO%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for BT16%20TPO: 1
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 38d36d03-f942-5838-98e9-4f1c879172c5 with identifier: BT16%20TPO
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: DA65%20YOO
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA65%2520YOO%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for DA65%20YOO: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: EJ15%20LVF
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ15%2520LVF%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for EJ15%20LVF: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: OV14%20UEZ
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV14%2520UEZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for OV14%20UEZ: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: OY16%20UYX
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520UYX%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for OY16%20UYX: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: SJ17%20NRR
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ17%2520NRR%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for SJ17%20NRR: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: VK16%20KNM
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520KNM%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for VK16%20KNM: 1
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 408cf7cd-5c88-5b19-ae14-d015866edb29 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 9 for item b761556c-b9e2-584e-8b60-6ef79cfe0123 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 8 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: BF62%20JWL
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF62%2520JWL%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for BF62%20JWL: 1
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: EF64%20PYO
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF64%2520PYO%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for EF64%20PYO: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: EX13%20UJA
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UJA%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for EX13%20UJA: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: FY11%20SBZ
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520SBZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for FY11%20SBZ: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: OV09%20NOF
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV09%2520NOF%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for OV09%20NOF: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: WV20%20YFC
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520YFC%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for WV20%20YFC: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: NX18%20OER
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520OER%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for NX18%20OER: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: NY15%20BUO
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY15%2520BUO%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for NY15%20BUO: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: SN14%20XMR
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN14%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for SN14%20XMR: 1
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: EN67%20XLH
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN67%2520XLH%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for EN67%20XLH: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: NV07%20OAE
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV07%2520OAE%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for NV07%20OAE: 1
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: DL64%20RZO
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520RZO%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for DL64%20RZO: 1
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 89417644-08ea-5067-8a1b-e8adb9994e95 with identifier: DL64%20RZO
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: NJ64%20NVR
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ64%2520NVR%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for NJ64%20NVR: 0
2026-03-28 11:02:21 [bca.uk] INFO: Found listing with ID: NL65%20PXC
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL65%2520PXC%27 HTTP/1.1" 200 None
2026-03-28 11:02:21 [bca.uk] INFO: Scrape type for NL65%20PXC: 2
2026-03-28 11:02:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2cf3ae94-d407-5598-9120-8ddaa7e99bbe with identifier: NL65%20PXC
2026-03-28 11:02:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2cf3ae94-d407-5598-9120-8ddaa7e99bbe with scrape type 2
2026-03-28 11:02:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2cf3ae94-d407-5598-9120-8ddaa7e99bbe with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2cf3ae94-d407-5598-9120-8ddaa7e99bbe, identifier: NL65%20PXC
2026-03-28 11:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2cf3ae94-d407-5598-9120-8ddaa7e99bbe with identifier: NL65%20PXC
2026-03-28 11:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2cf3ae94-d407-5598-9120-8ddaa7e99bbe with identifier: NL65%20PXC
2026-03-28 11:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2cf3ae94-d407-5598-9120-8ddaa7e99bbe with identifier: NL65%20PXC to the API
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL65%20PXC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2cf3ae94-d407-5598-9120-8ddaa7e99bbe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL65 PXC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL65%20PXC&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 76465,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.2 P/T 110 URBAN CROSS MPV',
'transmission': 'manual',
'trim': 'P/T 110 URBAN CROSS',
'vin': 'VF3CUHNZ6FY115293',
'year': 2015}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL65%2520PXC%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [bca.uk] INFO: Saving data for NL65%20PXC: {'auction_closing_time': 1774778400.0, 'created_time': 1774564480.307463, 'last_price_update_time': 1774695742.4102}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL65%2520PXC') HTTP/1.1" 204 0
2026-03-28 11:02:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL07%20BVB-GB>
2026-03-28 11:02:22 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 4285709e-1eb4-5199-8692-2365a9114f52 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:22 [bca.uk] INFO: Found listing with ID: NX15%20OHH
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX15%2520OHH%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [bca.uk] INFO: Scrape type for NX15%20OHH: 2
2026-03-28 11:02:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1b5d80d8-f789-5699-a02e-8d7d10d540ad with identifier: NX15%20OHH
2026-03-28 11:02:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1b5d80d8-f789-5699-a02e-8d7d10d540ad with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1b5d80d8-f789-5699-a02e-8d7d10d540ad with scrape type 2
2026-03-28 11:02:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1b5d80d8-f789-5699-a02e-8d7d10d540ad, identifier: NX15%20OHH
2026-03-28 11:02:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1b5d80d8-f789-5699-a02e-8d7d10d540ad with identifier: NX15%20OHH
2026-03-28 11:02:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1b5d80d8-f789-5699-a02e-8d7d10d540ad with identifier: NX15%20OHH
2026-03-28 11:02:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1b5d80d8-f789-5699-a02e-8d7d10d540ad with identifier: NX15%20OHH to the API
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NX15%20OHH-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1b5d80d8-f789-5699-a02e-8d7d10d540ad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NX15 OHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NX15%20OHH&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FIAT',
'model': '500',
'odometer': 61522,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP S/S Hatchback',
'transmission': 'manual',
'trim': 'POP S/S',
'vin': 'ZFA3120000J333369',
'year': 2015}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX15%2520OHH%27 HTTP/1.1" 200 None
2026-03-28 11:02:22 [bca.uk] INFO: Saving data for NX15%20OHH: {'auction_closing_time': 1774778400.0, 'created_time': 1774448162.509285, 'last_price_update_time': 1774695742.98335}
2026-03-28 11:02:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NX15%2520OHH') HTTP/1.1" 204 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: VN64%20YVX
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520YVX%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for VN64%20YVX: 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: VO66%20FHR
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO66%2520FHR%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for VO66%20FHR: 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: YP64%20FXK
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP64%2520FXK%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for YP64%20FXK: 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: NA20%20MYY
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA20%2520MYY%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for NA20%20MYY: 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: NG17%20ZRR
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520ZRR%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for NG17%20ZRR: 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: AF14%20UDV
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF14%2520UDV%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for AF14%20UDV: 2
2026-03-28 11:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd62b22f-bb41-5a84-b2af-3bd95a75b523 with identifier: AF14%20UDV
2026-03-28 11:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd62b22f-bb41-5a84-b2af-3bd95a75b523 with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd62b22f-bb41-5a84-b2af-3bd95a75b523 with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bd62b22f-bb41-5a84-b2af-3bd95a75b523, identifier: AF14%20UDV
2026-03-28 11:02:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU09%20BHP-GB>
2026-03-28 11:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bd62b22f-bb41-5a84-b2af-3bd95a75b523 with identifier: AF14%20UDV
2026-03-28 11:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bd62b22f-bb41-5a84-b2af-3bd95a75b523 with identifier: AF14%20UDV
2026-03-28 11:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bd62b22f-bb41-5a84-b2af-3bd95a75b523 with identifier: AF14%20UDV to the API
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF14%20UDV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bd62b22f-bb41-5a84-b2af-3bd95a75b523',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AF14 UDV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF14%20UDV&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'S-MAX',
'odometer': 93255,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD S-MAX 2.0 TDCI 163 TITANIUM X SPORT P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 163 TITANIUM X SPORT P/S',
'vin': 'WF0SXXGBWSEY29452',
'year': 2014}
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF14%2520UDV%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Saving data for AF14%20UDV: {'auction_closing_time': 1774864800.0, 'created_time': 1774563923.019701, 'last_price_update_time': 1774695743.577713}
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF14%2520UDV') HTTP/1.1" 204 0
2026-03-28 11:02:23 [bca.uk] INFO: Found listing with ID: BJ17%20OUK
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ17%2520OUK%27 HTTP/1.1" 200 None
2026-03-28 11:02:23 [bca.uk] INFO: Scrape type for BJ17%20OUK: 2
2026-03-28 11:02:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5f75641-5f6c-55e6-8873-faf4fcbd1340 with identifier: BJ17%20OUK
2026-03-28 11:02:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5f75641-5f6c-55e6-8873-faf4fcbd1340 with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5f75641-5f6c-55e6-8873-faf4fcbd1340 with scrape type 2
2026-03-28 11:02:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5f75641-5f6c-55e6-8873-faf4fcbd1340, identifier: BJ17%20OUK
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 1 for item 168964c4-009e-5f86-a5de-a609e726f9b5 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 3c1070f3-e634-5279-aa25-131d59b68f50 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 408cf7cd-5c88-5b19-ae14-d015866edb29 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 6 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 4 for item 46d5df6b-48cf-580f-b920-c2fa62de29df due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.middlewares.photo_download_middleware] DEBUG: Failed to download image 7 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 due to Could not open CONNECT tunnel with proxy ddc.oxylabs.io:8000 [{'status': 429, 'reason': b'Too Many Requests'}]
2026-03-28 11:02:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5f75641-5f6c-55e6-8873-faf4fcbd1340 with identifier: BJ17%20OUK
2026-03-28 11:02:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5f75641-5f6c-55e6-8873-faf4fcbd1340 with identifier: BJ17%20OUK
2026-03-28 11:02:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5f75641-5f6c-55e6-8873-faf4fcbd1340 with identifier: BJ17%20OUK to the API
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ17%20OUK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f5f75641-5f6c-55e6-8873-faf4fcbd1340',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ17 OUK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ17%20OUK&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MERCEDES-BENZ',
'model': 'E220 D',
'odometer': 71519,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E220 D 2.0 AMG LINE 9G Coupe',
'transmission': 'manual',
'trim': 'AMG LINE 9G',
'vin': 'WDD2383142F003253',
'year': 2017}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ17%2520OUK%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [bca.uk] INFO: Saving data for BJ17%20OUK: {'auction_closing_time': 1774864800.0, 'created_time': 1774563946.913645, 'last_price_update_time': 1774695744.067804}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ17%2520OUK') HTTP/1.1" 204 0
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA08%20SVO-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX72%20KYH-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN14%20XMR-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK17%20UZV-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE06%20HAU-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN68%20XXC-GB>
2026-03-28 11:02:24 [bca.uk] INFO: Found listing with ID: NL15%20BYY
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL15%2520BYY%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [bca.uk] INFO: Scrape type for NL15%20BYY: 2
2026-03-28 11:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01123fa5-1199-5609-8f6a-d940ceb7d8a4 with identifier: NL15%20BYY
2026-03-28 11:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 01123fa5-1199-5609-8f6a-d940ceb7d8a4 with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 01123fa5-1199-5609-8f6a-d940ceb7d8a4 with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01123fa5-1199-5609-8f6a-d940ceb7d8a4, identifier: NL15%20BYY
2026-03-28 11:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01123fa5-1199-5609-8f6a-d940ceb7d8a4 with identifier: NL15%20BYY
2026-03-28 11:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01123fa5-1199-5609-8f6a-d940ceb7d8a4 with identifier: NL15%20BYY
2026-03-28 11:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01123fa5-1199-5609-8f6a-d940ceb7d8a4 with identifier: NL15%20BYY to the API
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL15%20BYY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '01123fa5-1199-5609-8f6a-d940ceb7d8a4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL15 BYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL15%20BYY&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SKODA',
'model': 'RAPID SPACEBACK',
'odometer': 116444,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA RAPID SPACEBACK 1.6 TDI 90 SE TECH DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 90 SE TECH DSG',
'vin': 'TMBFJ6NHXF4521818',
'year': 2015}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL15%2520BYY%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [bca.uk] INFO: Saving data for NL15%20BYY: {'auction_closing_time': 1774864800.0, 'created_time': 1774563937.327214, 'last_price_update_time': 1774695744.550282}
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL15%2520BYY') HTTP/1.1" 204 0
2026-03-28 11:02:24 [bca.uk] INFO: Found listing with ID: NV11%20WJG
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV11%2520WJG%27 HTTP/1.1" 200 None
2026-03-28 11:02:24 [bca.uk] INFO: Scrape type for NV11%20WJG: 2
2026-03-28 11:02:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 073d4469-37e8-53f5-a1bb-a1ed23797009 with identifier: NV11%20WJG
2026-03-28 11:02:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 073d4469-37e8-53f5-a1bb-a1ed23797009 with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 073d4469-37e8-53f5-a1bb-a1ed23797009 with scrape type 2
2026-03-28 11:02:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 073d4469-37e8-53f5-a1bb-a1ed23797009, identifier: NV11%20WJG
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK69%20PZB-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT16%20TPO-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK16%20KNM-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV07%20OAE-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DL64%20RZO-GB>
2026-03-28 11:02:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF62%20JWL-GB>
2026-03-28 11:02:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 073d4469-37e8-53f5-a1bb-a1ed23797009 with identifier: NV11%20WJG
2026-03-28 11:02:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 073d4469-37e8-53f5-a1bb-a1ed23797009 with identifier: NV11%20WJG
2026-03-28 11:02:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 073d4469-37e8-53f5-a1bb-a1ed23797009 with identifier: NV11%20WJG to the API
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV11%20WJG-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '073d4469-37e8-53f5-a1bb-a1ed23797009',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV11 WJG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV11%20WJG&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 98115,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.2 60 S Hatchback',
'transmission': 'manual',
'trim': '60 S',
'vin': 'WVWZZZ6RZBU084407',
'year': 2011}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV11%2520WJG%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [bca.uk] INFO: Saving data for NV11%20WJG: {'auction_closing_time': 1774778400.0, 'created_time': 1774305518.507479, 'last_price_update_time': 1774695745.070021}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV11%2520WJG') HTTP/1.1" 204 0
2026-03-28 11:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:25 [bca.uk] INFO: Found listing with ID: RJ18%20UXW
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520UXW%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [bca.uk] INFO: Scrape type for RJ18%20UXW: 2
2026-03-28 11:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 04a89aa4-efd4-5ed5-8063-e6b31120a1d9 with identifier: RJ18%20UXW
2026-03-28 11:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 04a89aa4-efd4-5ed5-8063-e6b31120a1d9 with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 04a89aa4-efd4-5ed5-8063-e6b31120a1d9 with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 04a89aa4-efd4-5ed5-8063-e6b31120a1d9, identifier: RJ18%20UXW
2026-03-28 11:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 04a89aa4-efd4-5ed5-8063-e6b31120a1d9 with identifier: RJ18%20UXW
2026-03-28 11:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 04a89aa4-efd4-5ed5-8063-e6b31120a1d9 with identifier: RJ18%20UXW
2026-03-28 11:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 04a89aa4-efd4-5ed5-8063-e6b31120a1d9 with identifier: RJ18%20UXW to the API
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ18%20UXW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '04a89aa4-efd4-5ed5-8063-e6b31120a1d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ18 UXW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ18%20UXW&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'AUDI',
'model': 'A4',
'odometer': 134970,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 TDI 140 SE Saloon',
'transmission': 'manual',
'trim': 'TDI 140 SE',
'vin': 'WAUZZZF40JA201613',
'year': 2018}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520UXW%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [bca.uk] INFO: Saving data for RJ18%20UXW: {'auction_closing_time': 1774778400.0, 'created_time': 1774476308.789799, 'last_price_update_time': 1774695745.609142}
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ18%2520UXW') HTTP/1.1" 204 0
2026-03-28 11:02:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP19%20KZX-GB>
2026-03-28 11:02:25 [bca.uk] INFO: Found listing with ID: SA15%20FDF
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA15%2520FDF%27 HTTP/1.1" 200 None
2026-03-28 11:02:25 [bca.uk] INFO: Scrape type for SA15%20FDF: 2
2026-03-28 11:02:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77db1a56-4f47-5285-baa8-4d561581f263 with identifier: SA15%20FDF
2026-03-28 11:02:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77db1a56-4f47-5285-baa8-4d561581f263 with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77db1a56-4f47-5285-baa8-4d561581f263 with scrape type 2
2026-03-28 11:02:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77db1a56-4f47-5285-baa8-4d561581f263, identifier: SA15%20FDF
2026-03-28 11:02:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77db1a56-4f47-5285-baa8-4d561581f263 with identifier: SA15%20FDF
2026-03-28 11:02:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77db1a56-4f47-5285-baa8-4d561581f263 with identifier: SA15%20FDF
2026-03-28 11:02:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77db1a56-4f47-5285-baa8-4d561581f263 with identifier: SA15%20FDF to the API
2026-03-28 11:02:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA15%20FDF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '77db1a56-4f47-5285-baa8-4d561581f263',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA15 FDF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA15%20FDF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MITSUBISHI',
'model': 'OUTLANDER',
'odometer': 106067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MITSUBISHI OUTLANDER 2.2 DI-D GX3 4WD StationWagon',
'transmission': 'manual',
'trim': 'DI-D GX3 4WD',
'vin': 'JMAXJGF6WEZD01487',
'year': 2015}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA15%2520FDF%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [bca.uk] INFO: Saving data for SA15%20FDF: {'auction_closing_time': 1774778400.0, 'created_time': 1774305519.960772, 'last_price_update_time': 1774695746.166201}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA15%2520FDF') HTTP/1.1" 204 0
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d1e50>
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_expert_report_file_8c392565-4849-4593-9050-431ad55d4c02.pdf HTTP/1.1" 201 0
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 965bc451-0889-5f8d-976c-d99f3e039949, skipping ID generation
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL07BVB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL07BVB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:26 [bca.uk] INFO: Found listing with ID: SM13%20YUF
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520YUF%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [bca.uk] INFO: Scrape type for SM13%20YUF: 2
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9df181bd-6ba8-53bd-8f45-3503b8e3476b with identifier: SM13%20YUF
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9df181bd-6ba8-53bd-8f45-3503b8e3476b with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9df181bd-6ba8-53bd-8f45-3503b8e3476b with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9df181bd-6ba8-53bd-8f45-3503b8e3476b, identifier: SM13%20YUF
2026-03-28 11:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9df181bd-6ba8-53bd-8f45-3503b8e3476b with identifier: SM13%20YUF
2026-03-28 11:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9df181bd-6ba8-53bd-8f45-3503b8e3476b with identifier: SM13%20YUF
2026-03-28 11:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9df181bd-6ba8-53bd-8f45-3503b8e3476b with identifier: SM13%20YUF to the API
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM13%20YUF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9df181bd-6ba8-53bd-8f45-3503b8e3476b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM13 YUF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM13%20YUF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'TOYOTA',
'model': 'RAV4',
'odometer': 104079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'TOYOTA RAV4 2.2 D 148 ICON 4WD StationWagon',
'transmission': 'manual',
'trim': 'D 148 ICON 4WD',
'vin': 'JTMRCREV00D016182',
'year': 2013}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520YUF%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [bca.uk] INFO: Saving data for SM13%20YUF: {'auction_closing_time': 1774778400.0, 'created_time': 1774478318.482063, 'last_price_update_time': 1774695746.705566}
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM13%2520YUF') HTTP/1.1" 204 0
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906821%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906821 not downloaded yet
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea9a810>
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_expert_report_file_727a3a5a-2210-4d29-97f1-023b5c0ecb96.pdf HTTP/1.1" 201 0
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7cf4ba2-074e-565a-8e3d-b27be7a9586a, skipping ID generation
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU09BHP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU09BHP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:26 [bca.uk] INFO: Found listing with ID: SP59%20HRM
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520HRM%27 HTTP/1.1" 200 None
2026-03-28 11:02:26 [bca.uk] INFO: Scrape type for SP59%20HRM: 2
2026-03-28 11:02:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c233cd4-991c-5121-bd31-6d1f5315b814 with identifier: SP59%20HRM
2026-03-28 11:02:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c233cd4-991c-5121-bd31-6d1f5315b814 with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c233cd4-991c-5121-bd31-6d1f5315b814 with scrape type 2
2026-03-28 11:02:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c233cd4-991c-5121-bd31-6d1f5315b814, identifier: SP59%20HRM
2026-03-28 11:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c233cd4-991c-5121-bd31-6d1f5315b814 with identifier: SP59%20HRM
2026-03-28 11:02:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c233cd4-991c-5121-bd31-6d1f5315b814 with identifier: SP59%20HRM
2026-03-28 11:02:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c233cd4-991c-5121-bd31-6d1f5315b814 with identifier: SP59%20HRM to the API
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP59%20HRM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9c233cd4-991c-5121-bd31-6d1f5315b814',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP59 HRM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP59%20HRM&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLVO',
'model': 'V50',
'odometer': 99955,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO V50 2.0 D S P/SHIFT Estate',
'transmission': 'automatic',
'trim': 'D S P/SHIFT',
'vin': 'YV1MW755BA2547242',
'year': 2009}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP59%2520HRM%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [bca.uk] INFO: Saving data for SP59%20HRM: {'auction_closing_time': 1774778400.0, 'created_time': 1774563937.694613, 'last_price_update_time': 1774695747.272304}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP59%2520HRM') HTTP/1.1" 204 0
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906823%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906823 not downloaded yet
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907392%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907392 not downloaded yet
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8af950>
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_expert_report_file_40bfee53-c0cf-4883-b4ea-8ce4d39ff0e9.pdf HTTP/1.1" 201 0
2026-03-28 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3902049c-7c47-5636-bbb3-3468c754f44d, skipping ID generation
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNK17UZV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NK17UZV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb80e50>
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_expert_report_file_9b59233c-976e-451c-bb0d-069127e2e5eb.pdf HTTP/1.1" 201 0
2026-03-28 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80b8c73c-e33d-5f05-b1b8-6f3101793112, skipping ID generation
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWN68XXC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN68XXC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8af8d0>
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_expert_report_file_9045c3ce-c58c-44fa-81f6-3c4f57f0d0a3.pdf HTTP/1.1" 201 0
2026-03-28 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:02:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6385dff-e339-5db1-941b-499da54c4996, skipping ID generation
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPX72KYH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX72KYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:27 [bca.uk] INFO: Found listing with ID: SU06%20XOV
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SU06%2520XOV%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [bca.uk] INFO: Scrape type for SU06%20XOV: 0
2026-03-28 11:02:27 [bca.uk] INFO: Found listing with ID: WV62%20MWJ
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520MWJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:27 [bca.uk] INFO: Scrape type for WV62%20MWJ: 2
2026-03-28 11:02:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b485fd0c-f16c-5110-a480-3b9be1978ccf with identifier: WV62%20MWJ
2026-03-28 11:02:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b485fd0c-f16c-5110-a480-3b9be1978ccf with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b485fd0c-f16c-5110-a480-3b9be1978ccf with scrape type 2
2026-03-28 11:02:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b485fd0c-f16c-5110-a480-3b9be1978ccf, identifier: WV62%20MWJ
2026-03-28 11:02:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b485fd0c-f16c-5110-a480-3b9be1978ccf with identifier: WV62%20MWJ
2026-03-28 11:02:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b485fd0c-f16c-5110-a480-3b9be1978ccf with identifier: WV62%20MWJ
2026-03-28 11:02:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b485fd0c-f16c-5110-a480-3b9be1978ccf with identifier: WV62%20MWJ to the API
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV62%20MWJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b485fd0c-f16c-5110-a480-3b9be1978ccf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV62 MWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV62%20MWJ&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'PEUGEOT',
'model': '308',
'odometer': 80107,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.6 HDI 92 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'HDI 92 ACTIVE',
'vin': 'VF34C9HP0CS197627',
'year': 2012}
2026-03-28 11:02:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV62%2520MWJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Saving data for WV62%20MWJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774564517.323443, 'last_price_update_time': 1774695748.00536}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV62%2520MWJ') HTTP/1.1" 204 0
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906825%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906825 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907400%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907400 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411952%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411952 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786267%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786267 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719362%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719362 not downloaded yet
2026-03-28 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802722/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802722>
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: Y7%20ECR
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y7%2520ECR%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for Y7%20ECR: 0
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: YD11%20KRU
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD11%2520KRU%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for YD11%20KRU: 2
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11397d5a-5dbe-5209-b16d-e880ef3f1c98 with identifier: YD11%20KRU
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11397d5a-5dbe-5209-b16d-e880ef3f1c98 with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11397d5a-5dbe-5209-b16d-e880ef3f1c98 with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 11397d5a-5dbe-5209-b16d-e880ef3f1c98, identifier: YD11%20KRU
2026-03-28 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 11397d5a-5dbe-5209-b16d-e880ef3f1c98 with identifier: YD11%20KRU
2026-03-28 11:02:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 11397d5a-5dbe-5209-b16d-e880ef3f1c98 with identifier: YD11%20KRU
2026-03-28 11:02:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 11397d5a-5dbe-5209-b16d-e880ef3f1c98 with identifier: YD11%20KRU to the API
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD11%20KRU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '11397d5a-5dbe-5209-b16d-e880ef3f1c98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD11 KRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD11%20KRU&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'LAND ROVER',
'model': 'FREELANDER 2',
'odometer': 118443,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'LAND ROVER FREELANDER 2 2.2 TD4 150 S StationWagon',
'transmission': 'manual',
'trim': 'TD4 150 S',
'vin': 'SALFA2CC8BH241200',
'year': 2011}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD11%2520KRU%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Saving data for YD11%20KRU: {'auction_closing_time': 1774778400.0, 'created_time': 1774478280.674531, 'last_price_update_time': 1774695748.565993}
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD11%2520KRU') HTTP/1.1" 204 0
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906828%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906828 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907412%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907412 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411959%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411959 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786283%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786283 not downloaded yet
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719371%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719371 not downloaded yet
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff36fd0>
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_expert_report_file_a4478f18-82ae-44d3-88b3-06e530cfd3a7.pdf HTTP/1.1" 201 0
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55f920ab-4050-5691-ad66-7855c10b1d1d, skipping ID generation
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAE06HAU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE06HAU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0af50>
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_expert_report_file_cf8267ca-5956-4d6a-ba4f-8334143547fc.pdf HTTP/1.1" 201 0
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8add0ce3-3dfb-5144-93ab-96b2c1497c86, skipping ID generation
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSN14XMR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SN14XMR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1bd90>
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_expert_report_file_d3a04810-2fe8-4de2-9952-d3286a585dd5.pdf HTTP/1.1" 201 0
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 635e2677-2002-50d0-a57a-a285b9386cd8, skipping ID generation
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEA08SVO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA08SVO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: KU63%20OUW
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520OUW%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for KU63%20OUW: 0
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: MA07%20OEU
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA07%2520OEU%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for MA07%20OEU: 0
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: NA62%20FJJ
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA62%2520FJJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for NA62%20FJJ: 0
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: NC13%20CGF
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC13%2520CGF%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for NC13%20CGF: 0
2026-03-28 11:02:28 [bca.uk] INFO: Found listing with ID: ND58%20HME
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND58%2520HME%27 HTTP/1.1" 200 None
2026-03-28 11:02:28 [bca.uk] INFO: Scrape type for ND58%20HME: 2
2026-03-28 11:02:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e10adfe9-ee2a-5858-badc-280e0ef09673 with identifier: ND58%20HME
2026-03-28 11:02:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e10adfe9-ee2a-5858-badc-280e0ef09673 with scrape type 2
2026-03-28 11:02:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e10adfe9-ee2a-5858-badc-280e0ef09673 with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e10adfe9-ee2a-5858-badc-280e0ef09673, identifier: ND58%20HME
2026-03-28 11:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e10adfe9-ee2a-5858-badc-280e0ef09673 with identifier: ND58%20HME
2026-03-28 11:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e10adfe9-ee2a-5858-badc-280e0ef09673 with identifier: ND58%20HME
2026-03-28 11:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e10adfe9-ee2a-5858-badc-280e0ef09673 with identifier: ND58%20HME to the API
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND58%20HME-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e10adfe9-ee2a-5858-badc-280e0ef09673',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND58 HME',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND58%20HME&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 113260,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.9 TDI B/M MATCH Hatchback',
'transmission': 'manual',
'trim': 'TDI B/M MATCH',
'vin': 'WVWZZZ1KZ9W117645',
'year': 2008}
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND58%2520HME%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [bca.uk] INFO: Saving data for ND58%20HME: {'auction_closing_time': 1774778400.0, 'created_time': 1774392252.88868, 'last_price_update_time': 1774695749.425696}
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND58%2520HME') HTTP/1.1" 204 0
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906830%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906830 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907426%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907426 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411965%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411965 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786299%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786299 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719380%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719380 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905779%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905779 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797507%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797507 not downloaded yet
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907391%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907391 not downloaded yet
2026-03-28 11:02:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6bc90>
2026-03-28 11:02:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_expert_report_file_9bb25167-d266-4785-b2c0-5cf2b896232f.pdf HTTP/1.1" 201 0
2026-03-28 11:02:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:02:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38d36d03-f942-5838-98e9-4f1c879172c5, skipping ID generation
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBT16TPO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT16TPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802750>
2026-03-28 11:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915717>
2026-03-28 11:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL07BVB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915699/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915699>
2026-03-28 11:02:29 [bca.uk] INFO: Found listing with ID: NG12%20FFB
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG12%2520FFB%27 HTTP/1.1" 200 None
2026-03-28 11:02:29 [bca.uk] INFO: Scrape type for NG12%20FFB: 2
2026-03-28 11:02:29 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ae92cf0-8982-5ce9-bedc-83b00342f2db with identifier: NG12%20FFB
2026-03-28 11:02:29 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8ae92cf0-8982-5ce9-bedc-83b00342f2db with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8ae92cf0-8982-5ce9-bedc-83b00342f2db with scrape type 2
2026-03-28 11:02:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8ae92cf0-8982-5ce9-bedc-83b00342f2db, identifier: NG12%20FFB
2026-03-28 11:02:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8ae92cf0-8982-5ce9-bedc-83b00342f2db with identifier: NG12%20FFB
2026-03-28 11:02:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8ae92cf0-8982-5ce9-bedc-83b00342f2db with identifier: NG12%20FFB
2026-03-28 11:02:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8ae92cf0-8982-5ce9-bedc-83b00342f2db with identifier: NG12%20FFB to the API
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG12%20FFB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8ae92cf0-8982-5ce9-bedc-83b00342f2db',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG12 FFB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG12%20FFB&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'SKODA',
'model': 'CITIGO',
'odometer': 95939,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SKODA CITIGO 1.0 MPI 60 S Hatchback',
'transmission': 'manual',
'trim': 'MPI 60 S',
'vin': 'TMBZZZAAZDD607049',
'year': 2012}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG12%2520FFB%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [bca.uk] INFO: Saving data for NG12%20FFB: {'auction_closing_time': 1774778400.0, 'created_time': 1774476311.798047, 'last_price_update_time': 1774695750.231638}
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG12%2520FFB') HTTP/1.1" 204 0
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906833%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906833 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907441%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907441 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411970%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411970 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786321%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786321 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719399%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719399 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905780%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905780 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797512%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797512 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907399%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907399 not downloaded yet
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731357%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731357 not downloaded yet
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6c990>
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_expert_report_file_561704b1-d1d6-4809-8079-72418bb863c5.pdf HTTP/1.1" 201 0
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9ee147d-a1ed-542d-93b8-9e136eeb16c2, skipping ID generation
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBF62JWL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BF62JWL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b2f50>
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_expert_report_file_3abb1ae4-038d-4f6a-b91f-14168c273297.pdf HTTP/1.1" 201 0
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89417644-08ea-5067-8a1b-e8adb9994e95, skipping ID generation
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDL64RZO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DL64RZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3be190>
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_expert_report_file_77f226bb-9023-46a1-b9e5-ba3ff811866e.pdf HTTP/1.1" 201 0
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659, skipping ID generation
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVK16KNM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK16KNM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b5dd0>
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_expert_report_file_da735c91-db87-407e-aacd-166971375dd5.pdf HTTP/1.1" 201 0
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb, skipping ID generation
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYK69PZB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK69PZB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906821>
2026-03-28 11:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PX72KYH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU09BHP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:30 [bca.uk] INFO: Found listing with ID: NL12%20SOU
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 11:02:30 [bca.uk] INFO: Scrape type for NL12%20SOU: 2
2026-03-28 11:02:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 80f6ad38-ba07-5345-8979-f102d31f78cf with identifier: NL12%20SOU
2026-03-28 11:02:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 80f6ad38-ba07-5345-8979-f102d31f78cf with scrape type 2
2026-03-28 11:02:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 80f6ad38-ba07-5345-8979-f102d31f78cf with scrape type 2
2026-03-28 11:02:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80f6ad38-ba07-5345-8979-f102d31f78cf, identifier: NL12%20SOU
2026-03-28 11:02:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80f6ad38-ba07-5345-8979-f102d31f78cf with identifier: NL12%20SOU
2026-03-28 11:02:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80f6ad38-ba07-5345-8979-f102d31f78cf with identifier: NL12%20SOU
2026-03-28 11:02:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80f6ad38-ba07-5345-8979-f102d31f78cf with identifier: NL12%20SOU to the API
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL12%20SOU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '80f6ad38-ba07-5345-8979-f102d31f78cf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL12 SOU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL12%20SOU&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 129507,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'JAGUAR XF 2.2 D 190 PREMIUM LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D 190 PREMIUM LUXURY',
'vin': 'SAJAC0669CDS51492',
'year': 2012}
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [bca.uk] INFO: Saving data for NL12%20SOU: {'auction_closing_time': 1774778400.0, 'created_time': 1774305514.691348, 'last_price_update_time': 1774695751.383248}
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL12%2520SOU') HTTP/1.1" 204 0
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906835%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906835 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907453%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907453 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411973%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411973 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786334%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786334 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719409%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719409 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905782%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905782 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797520%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797520 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907409%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907409 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731373%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731373 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794247%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794247 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822387%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822387 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719391%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719391 not downloaded yet
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696661996%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696661996 not downloaded yet
2026-03-28 11:02:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3da150>
2026-03-28 11:02:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_expert_report_file_3742f5bc-9b06-4a11-a0d2-574481f88efb.pdf HTTP/1.1" 201 0
2026-03-28 11:02:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2, skipping ID generation
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNV07OAE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NV07OAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719362>
2026-03-28 11:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786267>
2026-03-28 11:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411952/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411952>
2026-03-28 11:02:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA08SVO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:31 [bca.uk] INFO: Found listing with ID: NL13%20WKA
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL13%2520WKA%27 HTTP/1.1" 200 None
2026-03-28 11:02:31 [bca.uk] INFO: Scrape type for NL13%20WKA: 2
2026-03-28 11:02:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5bf98b2-dd23-5053-90a4-a1db2bd553dd with identifier: NL13%20WKA
2026-03-28 11:02:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5bf98b2-dd23-5053-90a4-a1db2bd553dd with scrape type 2
2026-03-28 11:02:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5bf98b2-dd23-5053-90a4-a1db2bd553dd with scrape type 2
2026-03-28 11:02:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5bf98b2-dd23-5053-90a4-a1db2bd553dd, identifier: NL13%20WKA
2026-03-28 11:02:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5bf98b2-dd23-5053-90a4-a1db2bd553dd with identifier: NL13%20WKA
2026-03-28 11:02:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5bf98b2-dd23-5053-90a4-a1db2bd553dd with identifier: NL13%20WKA
2026-03-28 11:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5bf98b2-dd23-5053-90a4-a1db2bd553dd with identifier: NL13%20WKA to the API
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NL13%20WKA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f5bf98b2-dd23-5053-90a4-a1db2bd553dd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NL13 WKA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NL13%20WKA&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 103597,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I ICE Hatchback',
'transmission': 'manual',
'trim': 'VVT-I ICE',
'vin': 'JTDKG18C00N672264',
'year': 2013}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL13%2520WKA%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [bca.uk] INFO: Saving data for NL13%20WKA: {'auction_closing_time': 1774778400.0, 'created_time': 1774478318.102134, 'last_price_update_time': 1774695752.230841}
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NL13%2520WKA') HTTP/1.1" 204 0
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698906838%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906838 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907464%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907464 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411978%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411978 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786353%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786353 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719427%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719427 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905783%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905783 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797525%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797525 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907425%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907425 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731388%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731388 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794256%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794256 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822401%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822401 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719401%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719401 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696661997%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696661997 not downloaded yet
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787185%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787185 not downloaded yet
2026-03-28 11:02:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42de90>
2026-03-28 11:02:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_expert_report_file_888d8ba4-b558-4471-a468-10b509f883e5.pdf HTTP/1.1" 201 0
2026-03-28 11:02:32 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37884952-3501-544f-bd82-8874ad44a42b, skipping ID generation
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSP19KZX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP19KZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SN14XMR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905777/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AE06HAU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:32 [bca.uk] INFO: Found listing with ID: AJ58%20LJC
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ58%2520LJC%27 HTTP/1.1" 200 None
2026-03-28 11:02:32 [bca.uk] INFO: Scrape type for AJ58%20LJC: 2
2026-03-28 11:02:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 05b11402-3598-5ed3-a033-717f2b650c04 with identifier: AJ58%20LJC
2026-03-28 11:02:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 05b11402-3598-5ed3-a033-717f2b650c04 with scrape type 2
2026-03-28 11:02:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 05b11402-3598-5ed3-a033-717f2b650c04 with scrape type 2
2026-03-28 11:02:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 05b11402-3598-5ed3-a033-717f2b650c04, identifier: AJ58%20LJC
2026-03-28 11:02:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 05b11402-3598-5ed3-a033-717f2b650c04 with identifier: AJ58%20LJC
2026-03-28 11:02:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 05b11402-3598-5ed3-a033-717f2b650c04 with identifier: AJ58%20LJC
2026-03-28 11:02:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 05b11402-3598-5ed3-a033-717f2b650c04 with identifier: AJ58%20LJC to the API
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 189,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AJ58%20LJC-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '05b11402-3598-5ed3-a033-717f2b650c04',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AJ58 LJC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AJ58%20LJC&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 98469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD MONDEO 2.0 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0EXXGBBE8Y66065',
'year': 2008}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ58%2520LJC%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [bca.uk] INFO: Saving data for AJ58%20LJC: {'auction_closing_time': 1774778400.0, 'created_time': 1774478303.698653, 'last_price_update_time': 1774695753.073195}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AJ58%2520LJC') HTTP/1.1" 204 0
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907470%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907470 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411984%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411984 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786377%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786377 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719443%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719443 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905785%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905785 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797528%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797528 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907436%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907436 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731405%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731405 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794266%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794266 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822419%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822419 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719411%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719411 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662001%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662001 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787195%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787195 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794254%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794254 not downloaded yet
2026-03-28 11:02:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT16TPO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:33 [bca.uk] INFO: Found listing with ID: BJ13%20WXR
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520WXR%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [bca.uk] INFO: Scrape type for BJ13%20WXR: 2
2026-03-28 11:02:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3cdcda4e-5949-5570-af42-b9e56c4b0e36 with identifier: BJ13%20WXR
2026-03-28 11:02:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3cdcda4e-5949-5570-af42-b9e56c4b0e36 with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3cdcda4e-5949-5570-af42-b9e56c4b0e36 with scrape type 2
2026-03-28 11:02:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3cdcda4e-5949-5570-af42-b9e56c4b0e36, identifier: BJ13%20WXR
2026-03-28 11:02:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3cdcda4e-5949-5570-af42-b9e56c4b0e36 with identifier: BJ13%20WXR
2026-03-28 11:02:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3cdcda4e-5949-5570-af42-b9e56c4b0e36 with identifier: BJ13%20WXR
2026-03-28 11:02:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3cdcda4e-5949-5570-af42-b9e56c4b0e36 with identifier: BJ13%20WXR to the API
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ13%20WXR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3cdcda4e-5949-5570-af42-b9e56c4b0e36',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ13 WXR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ13%20WXR&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 121188,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.6 E-HDI 115 ACTIVE EGC MPV',
'transmission': 'automatic',
'trim': 'E-HDI 115 ACTIVE EGC',
'vin': 'VF30U9HD8DS050074',
'year': 2013}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ13%2520WXR%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [bca.uk] INFO: Saving data for BJ13%20WXR: {'auction_closing_time': 1774778400.0, 'created_time': 1774303499.601105, 'last_price_update_time': 1774695753.817559}
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ13%2520WXR') HTTP/1.1" 204 0
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411990%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411990 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786401%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786401 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719454%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719454 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905786%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905786 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797535%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797535 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907449%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907449 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731421%27 HTTP/1.1" 200 None
2026-03-28 11:02:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731421 not downloaded yet
2026-03-28 11:02:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794274%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794274 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822444%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822444 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719423%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719423 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662003%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662003 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787206%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787206 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794265%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794265 not downloaded yet
2026-03-28 11:02:34 [bca.uk] INFO: Found listing with ID: DS15%20CXK
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS15%2520CXK%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [bca.uk] INFO: Scrape type for DS15%20CXK: 0
2026-03-28 11:02:34 [bca.uk] INFO: Found listing with ID: DY61%20EZV
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY61%2520EZV%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [bca.uk] INFO: Scrape type for DY61%20EZV: 0
2026-03-28 11:02:34 [bca.uk] INFO: Found listing with ID: FG63%20FHC
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG63%2520FHC%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [bca.uk] INFO: Scrape type for FG63%20FHC: 2
2026-03-28 11:02:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018a27d7-fb6d-5b13-bb63-11174905cfe0 with identifier: FG63%20FHC
2026-03-28 11:02:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018a27d7-fb6d-5b13-bb63-11174905cfe0 with scrape type 2
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018a27d7-fb6d-5b13-bb63-11174905cfe0 with scrape type 2
2026-03-28 11:02:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 018a27d7-fb6d-5b13-bb63-11174905cfe0, identifier: FG63%20FHC
2026-03-28 11:02:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 018a27d7-fb6d-5b13-bb63-11174905cfe0 with identifier: FG63%20FHC
2026-03-28 11:02:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 018a27d7-fb6d-5b13-bb63-11174905cfe0 with identifier: FG63%20FHC
2026-03-28 11:02:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 018a27d7-fb6d-5b13-bb63-11174905cfe0 with identifier: FG63%20FHC to the API
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG63%20FHC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '018a27d7-fb6d-5b13-bb63-11174905cfe0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG63 FHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG63%20FHC&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'JAGUAR',
'model': 'XF SPORTBRAKE',
'odometer': 120870,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'JAGUAR XF SPORTBRAKE 2.2 D 163 R-SPORT Estate',
'transmission': 'automatic',
'trim': 'D 163 R-SPORT',
'vin': 'SAJAC01T4EDU13383',
'year': 2013}
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG63%2520FHC%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [bca.uk] INFO: Saving data for FG63%20FHC: {'auction_closing_time': 1774778400.0, 'created_time': 1774478304.06784, 'last_price_update_time': 1774695754.688157}
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG63%2520FHC') HTTP/1.1" 204 0
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698411997%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411997 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786420%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786420 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719468%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719468 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905788%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905788 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797543%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797543 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907463%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907463 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731446%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731446 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794282%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794282 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822466%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822466 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719432%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719432 not downloaded yet
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662006%27 HTTP/1.1" 200 None
2026-03-28 11:02:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662006 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787216%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787216 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794275%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794275 not downloaded yet
2026-03-28 11:02:35 [bca.uk] INFO: Found listing with ID: GJ56%20ZHY
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ56%2520ZHY%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Scrape type for GJ56%20ZHY: 0
2026-03-28 11:02:35 [bca.uk] INFO: Found listing with ID: YP13%20AUV
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP13%2520AUV%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Scrape type for YP13%20AUV: 2
2026-03-28 11:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 49e85d98-a9ae-5039-8316-0432f5b8731b with identifier: YP13%20AUV
2026-03-28 11:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 49e85d98-a9ae-5039-8316-0432f5b8731b with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 49e85d98-a9ae-5039-8316-0432f5b8731b with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 49e85d98-a9ae-5039-8316-0432f5b8731b, identifier: YP13%20AUV
2026-03-28 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 49e85d98-a9ae-5039-8316-0432f5b8731b with identifier: YP13%20AUV
2026-03-28 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 49e85d98-a9ae-5039-8316-0432f5b8731b with identifier: YP13%20AUV
2026-03-28 11:02:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 49e85d98-a9ae-5039-8316-0432f5b8731b with identifier: YP13%20AUV to the API
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP13%20AUV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '49e85d98-a9ae-5039-8316-0432f5b8731b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP13 AUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP13%20AUV&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 80333,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM X P/S StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM X P/S',
'vin': 'WF0AXXWPMADA89848',
'year': 2013}
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP13%2520AUV%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Saving data for YP13%20AUV: {'auction_closing_time': 1774864800.0, 'created_time': 1774353821.752687, 'last_price_update_time': 1774695755.537919}
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP13%2520AUV') HTTP/1.1" 204 0
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698905789%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905789 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797549%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797549 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698907468%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907468 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731479%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731479 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794294%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794294 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822510%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822510 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719442%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719442 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662010%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662010 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787228%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787228 not downloaded yet
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794287%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794287 not downloaded yet
2026-03-28 11:02:35 [bca.uk] INFO: Found listing with ID: KM14%20WMU
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520WMU%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Scrape type for KM14%20WMU: 0
2026-03-28 11:02:35 [bca.uk] INFO: Found listing with ID: VE11%20KHY
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE11%2520KHY%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Scrape type for VE11%20KHY: 0
2026-03-28 11:02:35 [bca.uk] INFO: Found listing with ID: VK13%20XCU
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK13%2520XCU%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Scrape type for VK13%20XCU: 0
2026-03-28 11:02:35 [bca.uk] INFO: Found listing with ID: YH13%20XTJ
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH13%2520XTJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:35 [bca.uk] INFO: Scrape type for YH13%20XTJ: 2
2026-03-28 11:02:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 014ce368-9be9-5ac0-8411-ed03b969e722 with identifier: YH13%20XTJ
2026-03-28 11:02:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 014ce368-9be9-5ac0-8411-ed03b969e722 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 014ce368-9be9-5ac0-8411-ed03b969e722 with scrape type 2
2026-03-28 11:02:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 014ce368-9be9-5ac0-8411-ed03b969e722, identifier: YH13%20XTJ
2026-03-28 11:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:02:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802722/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:02:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 014ce368-9be9-5ac0-8411-ed03b969e722 with identifier: YH13%20XTJ
2026-03-28 11:02:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 014ce368-9be9-5ac0-8411-ed03b969e722 with identifier: YH13%20XTJ
2026-03-28 11:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 014ce368-9be9-5ac0-8411-ed03b969e722 with identifier: YH13%20XTJ to the API
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH13%20XTJ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '014ce368-9be9-5ac0-8411-ed03b969e722',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH13 XTJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH13%20XTJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '320D',
'odometer': 145414,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 LUXURY STEP Saloon',
'transmission': 'automatic',
'trim': 'LUXURY STEP',
'vin': 'WBA3D32070J383085',
'year': 2013}
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH13%2520XTJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [bca.uk] INFO: Saving data for YH13%20XTJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774476288.729005, 'last_price_update_time': 1774695756.256171}
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH13%2520XTJ') HTTP/1.1" 204 0
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797555%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797555 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731502%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731502 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794304%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794304 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822534%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822534 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719455%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719455 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662016%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662016 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787244%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787244 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794293%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794293 not downloaded yet
2026-03-28 11:02:36 [bca.uk] INFO: Found listing with ID: BJ64%20NMF
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ64%2520NMF%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [bca.uk] INFO: Scrape type for BJ64%20NMF: 0
2026-03-28 11:02:36 [bca.uk] INFO: Found listing with ID: CK63%20ERY
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK63%2520ERY%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [bca.uk] INFO: Scrape type for CK63%20ERY: 1
2026-03-28 11:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b907f1ba-0626-5f40-a68a-546b49ab434a with identifier: CK63%20ERY
2026-03-28 11:02:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915699/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698731515%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731515 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794315%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794315 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822560%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822560 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719470%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719470 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662019%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662019 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787258%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787258 not downloaded yet
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794303%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794303 not downloaded yet
2026-03-28 11:02:36 [bca.uk] INFO: Found listing with ID: DA12%20NKC
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA12%2520NKC%27 HTTP/1.1" 200 None
2026-03-28 11:02:36 [bca.uk] INFO: Scrape type for DA12%20NKC: 2
2026-03-28 11:02:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 487a4c7d-e000-5731-9b87-cfbfd6d68e66 with identifier: DA12%20NKC
2026-03-28 11:02:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 487a4c7d-e000-5731-9b87-cfbfd6d68e66 with scrape type 2
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 487a4c7d-e000-5731-9b87-cfbfd6d68e66 with scrape type 2
2026-03-28 11:02:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 487a4c7d-e000-5731-9b87-cfbfd6d68e66, identifier: DA12%20NKC
2026-03-28 11:02:36 [bca.uk] INFO: Total items found: 100
2026-03-28 11:02:36 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded
2026-03-28 11:02:36 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:02:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2893d0>
2026-03-28 11:02:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802722%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802722/600 saved to cache
2026-03-28 11:02:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:02:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 487a4c7d-e000-5731-9b87-cfbfd6d68e66 with identifier: DA12%20NKC
2026-03-28 11:02:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 487a4c7d-e000-5731-9b87-cfbfd6d68e66 with identifier: DA12%20NKC
2026-03-28 11:02:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 487a4c7d-e000-5731-9b87-cfbfd6d68e66 with identifier: DA12%20NKC to the API
2026-03-28 11:02:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DA12%20NKC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '487a4c7d-e000-5731-9b87-cfbfd6d68e66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DA12 NKC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DA12%20NKC&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 66476,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'ZETEC',
'vin': 'WF0JXXGAJJCC64845',
'year': 2012}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA12%2520NKC%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [bca.uk] INFO: Saving data for DA12%20NKC: {'auction_closing_time': 1774778400.0, 'created_time': 1774478304.446318, 'last_price_update_time': 1774695757.20082}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DA12%2520NKC') HTTP/1.1" 204 0
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794324%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794324 not downloaded yet
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822578%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822578 not downloaded yet
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698719483%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719483 not downloaded yet
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696662022%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662022 not downloaded yet
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787270%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787270 not downloaded yet
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794314%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794314 not downloaded yet
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:02:37 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:37 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:37 [bca.uk] INFO: Found listing with ID: DV10%20LLK
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV10%2520LLK%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [bca.uk] INFO: Scrape type for DV10%20LLK: 2
2026-03-28 11:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a212a987-efec-51fd-8d6d-ef4848f75f22 with identifier: DV10%20LLK
2026-03-28 11:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a212a987-efec-51fd-8d6d-ef4848f75f22 with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a212a987-efec-51fd-8d6d-ef4848f75f22 with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a212a987-efec-51fd-8d6d-ef4848f75f22, identifier: DV10%20LLK
2026-03-28 11:02:37 [bca.uk] INFO: Found listing with ID: LP66%20TZU
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP66%2520TZU%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [bca.uk] INFO: Scrape type for LP66%20TZU: 1
2026-03-28 11:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2 with identifier: LP66%20TZU
2026-03-28 11:02:37 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:02:37 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac10d110>
2026-03-28 11:02:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915699%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915699/600 saved to cache
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411952/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:02:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a212a987-efec-51fd-8d6d-ef4848f75f22 with identifier: DV10%20LLK
2026-03-28 11:02:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a212a987-efec-51fd-8d6d-ef4848f75f22 with identifier: DV10%20LLK
2026-03-28 11:02:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a212a987-efec-51fd-8d6d-ef4848f75f22 with identifier: DV10%20LLK to the API
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV10%20LLK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a212a987-efec-51fd-8d6d-ef4848f75f22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV10 LLK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV10%20LLK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 103539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 EXCLUSIV Hatchback',
'transmission': 'manual',
'trim': '16V 115 EXCLUSIV',
'vin': 'W0LPD6ED3A8052886',
'year': 2010}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV10%2520LLK%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [bca.uk] INFO: Saving data for DV10%20LLK: {'auction_closing_time': 1774778400.0, 'created_time': 1774564516.955017, 'last_price_update_time': 1774695757.879902}
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV10%2520LLK') HTTP/1.1" 204 0
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787285%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787285 not downloaded yet
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794328%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794328 not downloaded yet
2026-03-28 11:02:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:02:37 [bca.uk] INFO: Found listing with ID: FV62%20LNA
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV62%2520LNA%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [bca.uk] INFO: Scrape type for FV62%20LNA: 0
2026-03-28 11:02:37 [bca.uk] INFO: Found listing with ID: KU63%20RYR
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520RYR%27 HTTP/1.1" 200 None
2026-03-28 11:02:37 [bca.uk] INFO: Scrape type for KU63%20RYR: 2
2026-03-28 11:02:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87c1f1cb-1e99-54cf-a1a8-270898239a39 with identifier: KU63%20RYR
2026-03-28 11:02:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87c1f1cb-1e99-54cf-a1a8-270898239a39 with scrape type 2
2026-03-28 11:02:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87c1f1cb-1e99-54cf-a1a8-270898239a39 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87c1f1cb-1e99-54cf-a1a8-270898239a39, identifier: KU63%20RYR
2026-03-28 11:02:38 [bca.uk] INFO: Found listing with ID: MA66%20DBU
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA66%2520DBU%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [bca.uk] INFO: Scrape type for MA66%20DBU: 1
2026-03-28 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fd76365-0d93-5f43-bb85-e0898d18c703 with identifier: MA66%20DBU
2026-03-28 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87c1f1cb-1e99-54cf-a1a8-270898239a39 with identifier: KU63%20RYR
2026-03-28 11:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87c1f1cb-1e99-54cf-a1a8-270898239a39 with identifier: KU63%20RYR
2026-03-28 11:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87c1f1cb-1e99-54cf-a1a8-270898239a39 with identifier: KU63%20RYR to the API
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KU63%20RYR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '87c1f1cb-1e99-54cf-a1a8-270898239a39',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KU63 RYR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KU63%20RYR&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 133954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.6 HDI 115 ALLURE MPV',
'transmission': 'manual',
'trim': 'HDI 115 ALLURE',
'vin': 'VF30E9HD8DS127735',
'year': 2013}
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520RYR%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [bca.uk] INFO: Saving data for KU63%20RYR: {'auction_closing_time': 1774778400.0, 'created_time': 1774476289.121224, 'last_price_update_time': 1774695758.457624}
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KU63%2520RYR') HTTP/1.1" 204 0
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794337%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794337 not downloaded yet
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb6a350>
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915717%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915717/600 saved to cache
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4d210>
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802750%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802750/600 saved to cache
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:02:38 [bca.uk] INFO: Found listing with ID: LD65%20WTN
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD65%2520WTN%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [bca.uk] INFO: Scrape type for LD65%20WTN: 2
2026-03-28 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 910ecacb-a24d-5d54-8a02-72d5c86e3121 with identifier: LD65%20WTN
2026-03-28 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 910ecacb-a24d-5d54-8a02-72d5c86e3121 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 910ecacb-a24d-5d54-8a02-72d5c86e3121 with scrape type 2
2026-03-28 11:02:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 910ecacb-a24d-5d54-8a02-72d5c86e3121, identifier: LD65%20WTN
2026-03-28 11:02:38 [bca.uk] INFO: Found listing with ID: EK58%20XAN
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK58%2520XAN%27 HTTP/1.1" 200 None
2026-03-28 11:02:38 [bca.uk] INFO: Scrape type for EK58%20XAN: 1
2026-03-28 11:02:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 86c3d5ed-6b33-5aac-81cc-1442ec105e02 with identifier: EK58%20XAN
2026-03-28 11:02:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9f3e50>
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907384%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907384/600 saved to cache
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe5d310>
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906818%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906818/600 saved to cache
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e86fcd0>
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411952%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411952/600 saved to cache
2026-03-28 11:02:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:02:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:02:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794287/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794287>
2026-03-28 11:02:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 910ecacb-a24d-5d54-8a02-72d5c86e3121 with identifier: LD65%20WTN
2026-03-28 11:02:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 910ecacb-a24d-5d54-8a02-72d5c86e3121 with identifier: LD65%20WTN
2026-03-28 11:02:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 910ecacb-a24d-5d54-8a02-72d5c86e3121 with identifier: LD65%20WTN to the API
2026-03-28 11:02:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD65%20WTN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '910ecacb-a24d-5d54-8a02-72d5c86e3121',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD65 WTN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD65%20WTN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 83455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 140 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'E/B 140 ZETEC S',
'vin': 'WF0CXXGAKCFU25903',
'year': 2015}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD65%2520WTN%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [bca.uk] INFO: Saving data for LD65%20WTN: {'auction_closing_time': 1774778400.0, 'created_time': 1774564519.196983, 'last_price_update_time': 1774695759.163286}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD65%2520WTN') HTTP/1.1" 204 0
2026-03-28 11:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787228>
2026-03-28 11:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK63%20ERY-GB>
2026-03-28 11:02:39 [bca.uk] INFO: Found listing with ID: LK08%20VFO
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VFO%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [bca.uk] INFO: Scrape type for LK08%20VFO: 2
2026-03-28 11:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 636e0036-3b01-572e-b234-5f2732ebb3f0 with identifier: LK08%20VFO
2026-03-28 11:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 636e0036-3b01-572e-b234-5f2732ebb3f0 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 636e0036-3b01-572e-b234-5f2732ebb3f0 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 636e0036-3b01-572e-b234-5f2732ebb3f0, identifier: LK08%20VFO
2026-03-28 11:02:39 [bca.uk] INFO: Found listing with ID: GU05%20ZMV
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520ZMV%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [bca.uk] INFO: Scrape type for GU05%20ZMV: 1
2026-03-28 11:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fb67be3a-90c8-5a60-a598-4f91805ebe76 with identifier: GU05%20ZMV
2026-03-28 11:02:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9ea90>
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719351%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719351/600 saved to cache
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac35d850>
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719362%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719362/600 saved to cache
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe98350>
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786267%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786267/600 saved to cache
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:02:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905777/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794303>
2026-03-28 11:02:39 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794314>
2026-03-28 11:02:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 636e0036-3b01-572e-b234-5f2732ebb3f0 with identifier: LK08%20VFO
2026-03-28 11:02:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 636e0036-3b01-572e-b234-5f2732ebb3f0 with identifier: LK08%20VFO
2026-03-28 11:02:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 636e0036-3b01-572e-b234-5f2732ebb3f0 with identifier: LK08%20VFO to the API
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LK08%20VFO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '636e0036-3b01-572e-b234-5f2732ebb3f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LK08 VFO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LK08%20VFO&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 154930,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 2.0 TDI PD LAURIN & KLEMENT DSG Estate',
'transmission': 'automatic',
'trim': 'TDI PD LAURIN & KLEMENT DSG',
'vin': 'TMBFE61ZX82131948',
'year': 2008}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VFO%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [bca.uk] INFO: Saving data for LK08%20VFO: {'auction_closing_time': 1774778400.0, 'created_time': 1774476297.848128, 'last_price_update_time': 1774695759.778183}
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LK08%2520VFO') HTTP/1.1" 204 0
2026-03-28 11:02:39 [bca.uk] INFO: Found listing with ID: MJ14%20UDS
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ14%2520UDS%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [bca.uk] INFO: Scrape type for MJ14%20UDS: 0
2026-03-28 11:02:39 [bca.uk] INFO: Found listing with ID: PO61%20YTU
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YTU%27 HTTP/1.1" 200 None
2026-03-28 11:02:39 [bca.uk] INFO: Scrape type for PO61%20YTU: 2
2026-03-28 11:02:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 76c45397-607e-55cd-8406-ce116d039761 with identifier: PO61%20YTU
2026-03-28 11:02:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 76c45397-607e-55cd-8406-ce116d039761 with scrape type 2
2026-03-28 11:02:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 76c45397-607e-55cd-8406-ce116d039761 with scrape type 2
2026-03-28 11:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 76c45397-607e-55cd-8406-ce116d039761, identifier: PO61%20YTU
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: GJ64%20FZB
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520FZB%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for GJ64%20FZB: 0
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: HX68%20KXL
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX68%2520KXL%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for HX68%20KXL: 1
2026-03-28 11:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: be8bbf41-9ce9-501b-87fe-5d2475363c5c with identifier: HX68%20KXL
2026-03-28 11:02:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea2f50>
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797502%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797502/600 saved to cache
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac474490>
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731338%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731338/600 saved to cache
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac354b50>
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907388%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907388/600 saved to cache
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac476290>
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906821%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906821/600 saved to cache
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787270>
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662022/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662022>
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP66%20TZU-GB>
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794328>
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787285>
2026-03-28 11:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 76c45397-607e-55cd-8406-ce116d039761 with identifier: PO61%20YTU
2026-03-28 11:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 76c45397-607e-55cd-8406-ce116d039761 with identifier: PO61%20YTU
2026-03-28 11:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 76c45397-607e-55cd-8406-ce116d039761 with identifier: PO61%20YTU to the API
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PO61%20YTU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '76c45397-607e-55cd-8406-ce116d039761',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PO61 YTU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PO61%20YTU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 114502,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'ZETEC S',
'vin': 'WF0GXXGAJGBS33597',
'year': 2011}
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO61%2520YTU%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Saving data for PO61%20YTU: {'auction_closing_time': 1774778400.0, 'created_time': 1774305502.257332, 'last_price_update_time': 1774695760.618048}
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PO61%2520YTU') HTTP/1.1" 204 0
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719483/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719483>
2026-03-28 11:02:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA66%20DBU-GB>
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: SH11%20WHB
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520WHB%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for SH11%20WHB: 2
2026-03-28 11:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 871185c6-df06-58f6-9277-2de5f7d59ce3 with identifier: SH11%20WHB
2026-03-28 11:02:40 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 871185c6-df06-58f6-9277-2de5f7d59ce3 with scrape type 2
2026-03-28 11:02:40 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 871185c6-df06-58f6-9277-2de5f7d59ce3 with scrape type 2
2026-03-28 11:02:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 871185c6-df06-58f6-9277-2de5f7d59ce3, identifier: SH11%20WHB
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: KR65%20CKN
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR65%2520CKN%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for KR65%20CKN: 0
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: SY65%20UOC
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY65%2520UOC%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for SY65%20UOC: 0
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: CK65%20BVE
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK65%2520BVE%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for CK65%20BVE: 0
2026-03-28 11:02:40 [bca.uk] INFO: Found listing with ID: BJ66%20YWK
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520YWK%27 HTTP/1.1" 200 None
2026-03-28 11:02:40 [bca.uk] INFO: Scrape type for BJ66%20YWK: 1
2026-03-28 11:02:40 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6 with identifier: BJ66%20YWK
2026-03-28 11:02:40 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:02:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 871185c6-df06-58f6-9277-2de5f7d59ce3 with identifier: SH11%20WHB
2026-03-28 11:02:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 871185c6-df06-58f6-9277-2de5f7d59ce3 with identifier: SH11%20WHB
2026-03-28 11:02:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 871185c6-df06-58f6-9277-2de5f7d59ce3 with identifier: SH11%20WHB to the API
2026-03-28 11:02:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH11%20WHB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '871185c6-df06-58f6-9277-2de5f7d59ce3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH11 WHB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH11%20WHB&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 88583,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.6 16V 110 DYNAMIQUE TOM TOM Hatchback',
'transmission': 'manual',
'trim': '16V 110 DYNAMIQUE TOM TOM',
'vin': 'VF1BZ1U0645244178',
'year': 2011}
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520WHB%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [bca.uk] INFO: Saving data for SH11%20WHB: {'auction_closing_time': 1774778400.0, 'created_time': 1774390850.791668, 'last_price_update_time': 1774695761.258118}
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH11%2520WHB') HTTP/1.1" 204 0
2026-03-28 11:02:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feaad90>
2026-03-28 11:02:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905777%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905777/600 saved to cache
2026-03-28 11:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK58%20XAN-GB>
2026-03-28 11:02:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794337>
2026-03-28 11:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794287/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:02:41 [bca.uk] INFO: Found listing with ID: BD62%20TXJ
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD62%2520TXJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [bca.uk] INFO: Scrape type for BD62%20TXJ: 2
2026-03-28 11:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dba91280-2e86-5886-9beb-6904b93a80ab with identifier: BD62%20TXJ
2026-03-28 11:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dba91280-2e86-5886-9beb-6904b93a80ab with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dba91280-2e86-5886-9beb-6904b93a80ab with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dba91280-2e86-5886-9beb-6904b93a80ab, identifier: BD62%20TXJ
2026-03-28 11:02:41 [bca.uk] INFO: Found listing with ID: LM60%20EUZ
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM60%2520EUZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [bca.uk] INFO: Scrape type for LM60%20EUZ: 0
2026-03-28 11:02:41 [bca.uk] INFO: Found listing with ID: M500%20MDC
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MDC%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [bca.uk] INFO: Scrape type for M500%20MDC: 0
2026-03-28 11:02:41 [bca.uk] INFO: Found listing with ID: YF13%20MDZ
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF13%2520MDZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [bca.uk] INFO: Scrape type for YF13%20MDZ: 0
2026-03-28 11:02:41 [bca.uk] INFO: Found listing with ID: BV12%20NRK
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV12%2520NRK%27 HTTP/1.1" 200 None
2026-03-28 11:02:41 [bca.uk] INFO: Scrape type for BV12%20NRK: 2
2026-03-28 11:02:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c52a2feb-154a-571f-9ecb-a811d7944ac1 with identifier: BV12%20NRK
2026-03-28 11:02:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c52a2feb-154a-571f-9ecb-a811d7944ac1 with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c52a2feb-154a-571f-9ecb-a811d7944ac1 with scrape type 2
2026-03-28 11:02:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c52a2feb-154a-571f-9ecb-a811d7944ac1, identifier: BV12%20NRK
2026-03-28 11:02:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:02:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dba91280-2e86-5886-9beb-6904b93a80ab with identifier: BD62%20TXJ
2026-03-28 11:02:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dba91280-2e86-5886-9beb-6904b93a80ab with identifier: BD62%20TXJ
2026-03-28 11:02:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dba91280-2e86-5886-9beb-6904b93a80ab with identifier: BD62%20TXJ to the API
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=3&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD62%20TXJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dba91280-2e86-5886-9beb-6904b93a80ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD62 TXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD62%20TXJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 120872,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0KXXGCBKCT36775',
'year': 2013}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD62%2520TXJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [bca.uk] INFO: Saving data for BD62%20TXJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774476296.038442, 'last_price_update_time': 1774695762.060263}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD62%2520TXJ') HTTP/1.1" 204 0
2026-03-28 11:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c52a2feb-154a-571f-9ecb-a811d7944ac1 with identifier: BV12%20NRK
2026-03-28 11:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c52a2feb-154a-571f-9ecb-a811d7944ac1 with identifier: BV12%20NRK
2026-03-28 11:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c52a2feb-154a-571f-9ecb-a811d7944ac1 with identifier: BV12%20NRK to the API
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 169,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BV12%20NRK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c52a2feb-154a-571f-9ecb-a811d7944ac1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BV12 NRK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BV12%20NRK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 55936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 240 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 240 LUXURY',
'vin': 'SAJAC0541CNS33207',
'year': 2012}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV12%2520NRK%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [bca.uk] INFO: Saving data for BV12%20NRK: {'auction_closing_time': 1774778400.0, 'created_time': 1774564518.425206, 'last_price_update_time': 1774695762.602073}
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BV12%2520NRK') HTTP/1.1" 204 0
2026-03-28 11:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822578>
2026-03-28 11:02:42 [bca.uk] INFO: Found listing with ID: SV70%20XPL
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV70%2520XPL%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [bca.uk] INFO: Scrape type for SV70%20XPL: 1
2026-03-28 11:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f2e9e7ea-51b4-5374-8434-69f905958f69 with identifier: SV70%20XPL
2026-03-28 11:02:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:02:42 [bca.uk] INFO: Found listing with ID: DF66%20HMU
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF66%2520HMU%27 HTTP/1.1" 200 None
2026-03-28 11:02:42 [bca.uk] INFO: Scrape type for DF66%20HMU: 2
2026-03-28 11:02:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 47189dd3-762a-5ba7-a614-b7330ae67974 with identifier: DF66%20HMU
2026-03-28 11:02:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 47189dd3-762a-5ba7-a614-b7330ae67974 with scrape type 2
2026-03-28 11:02:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 47189dd3-762a-5ba7-a614-b7330ae67974 with scrape type 2
2026-03-28 11:02:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 47189dd3-762a-5ba7-a614-b7330ae67974, identifier: DF66%20HMU
2026-03-28 11:02:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:02:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 47189dd3-762a-5ba7-a614-b7330ae67974 with identifier: DF66%20HMU
2026-03-28 11:02:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 47189dd3-762a-5ba7-a614-b7330ae67974 with identifier: DF66%20HMU
2026-03-28 11:02:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 47189dd3-762a-5ba7-a614-b7330ae67974 with identifier: DF66%20HMU to the API
2026-03-28 11:02:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DF66%20HMU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '47189dd3-762a-5ba7-a614-b7330ae67974',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DF66 HMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DF66%20HMU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 34720,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.2 TSI 90 COLOUR EDITION Hatchback',
'transmission': 'manual',
'trim': 'TSI 90 COLOUR EDITION',
'vin': 'TMBFM6NJ2HZ084140',
'year': 2016}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF66%2520HMU%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Saving data for DF66%20HMU: {'auction_closing_time': 1774778400.0, 'created_time': 1774476289.993248, 'last_price_update_time': 1774695763.184221}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DF66%2520HMU') HTTP/1.1" 204 0
2026-03-28 11:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662022/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:02:43 [bca.uk] INFO: Found listing with ID: FJ16%20NYD
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520NYD%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Scrape type for FJ16%20NYD: 0
2026-03-28 11:02:43 [bca.uk] INFO: Found listing with ID: FD19%20ARF
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD19%2520ARF%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Scrape type for FD19%20ARF: 1
2026-03-28 11:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9627a815-843b-5104-8c72-e08099ef2ec0 with identifier: FD19%20ARF
2026-03-28 11:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:02:43 [bca.uk] INFO: Found listing with ID: FH66%20SFV
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH66%2520SFV%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Scrape type for FH66%20SFV: 0
2026-03-28 11:02:43 [bca.uk] INFO: Found listing with ID: GF60%20JYK
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF60%2520JYK%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Scrape type for GF60%20JYK: 2
2026-03-28 11:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bd03e707-433e-5228-9ae4-bfc2889957eb with identifier: GF60%20JYK
2026-03-28 11:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bd03e707-433e-5228-9ae4-bfc2889957eb with scrape type 2
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bd03e707-433e-5228-9ae4-bfc2889957eb with scrape type 2
2026-03-28 11:02:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bd03e707-433e-5228-9ae4-bfc2889957eb, identifier: GF60%20JYK
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf73d0>
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787228%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787228/600 saved to cache
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac25c8d0>
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794287%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794287/600 saved to cache
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e849550>
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794314%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794314/600 saved to cache
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bd03e707-433e-5228-9ae4-bfc2889957eb with identifier: GF60%20JYK
2026-03-28 11:02:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bd03e707-433e-5228-9ae4-bfc2889957eb with identifier: GF60%20JYK
2026-03-28 11:02:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bd03e707-433e-5228-9ae4-bfc2889957eb with identifier: GF60%20JYK to the API
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF60%20JYK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bd03e707-433e-5228-9ae4-bfc2889957eb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF60 JYK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF60%20JYK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 136148,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 3.0 D TIPTRONIC S Estate',
'transmission': 'manual',
'trim': 'D TIPTRONIC S',
'vin': 'WP1ZZZ92ZBLA25146',
'year': 2010}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF60%2520JYK%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Saving data for GF60%20JYK: {'auction_closing_time': 1774778400.0, 'created_time': 1774476291.579184, 'last_price_update_time': 1774695763.853694}
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF60%2520JYK') HTTP/1.1" 204 0
2026-03-28 11:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:02:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719483/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:02:43 [bca.uk] INFO: Found listing with ID: KY59%20LSX
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY59%2520LSX%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Scrape type for KY59%20LSX: 1
2026-03-28 11:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ef4002b7-d31e-55a1-86f4-a46e5d38dc01 with identifier: KY59%20LSX
2026-03-28 11:02:43 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:02:43 [bca.uk] INFO: Found listing with ID: MA10%20MJF
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA10%2520MJF%27 HTTP/1.1" 200 None
2026-03-28 11:02:43 [bca.uk] INFO: Scrape type for MA10%20MJF: 2
2026-03-28 11:02:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 330a67d2-8894-509d-855f-5492a6fd9a2e with identifier: MA10%20MJF
2026-03-28 11:02:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 330a67d2-8894-509d-855f-5492a6fd9a2e with scrape type 2
2026-03-28 11:02:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 330a67d2-8894-509d-855f-5492a6fd9a2e with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 330a67d2-8894-509d-855f-5492a6fd9a2e, identifier: MA10%20MJF
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffccdd0>
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_expert_report_file_32f9e2e9-0942-4e4f-84c7-493ea5327005.pdf HTTP/1.1" 201 0
2026-03-28 11:02:44 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b907f1ba-0626-5f40-a68a-546b49ab434a, skipping ID generation
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DCK63ERY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CK63ERY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac410310>
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794303%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794303/600 saved to cache
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ66%20YWK-GB>
2026-03-28 11:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HX68%20KXL-GB>
2026-03-28 11:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 330a67d2-8894-509d-855f-5492a6fd9a2e with identifier: MA10%20MJF
2026-03-28 11:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 330a67d2-8894-509d-855f-5492a6fd9a2e with identifier: MA10%20MJF
2026-03-28 11:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 330a67d2-8894-509d-855f-5492a6fd9a2e with identifier: MA10%20MJF to the API
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA10%20MJF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '330a67d2-8894-509d-855f-5492a6fd9a2e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA10 MJF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA10%20MJF&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 93214,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 2.5 225 ST-3 Hatchback',
'transmission': 'manual',
'trim': '225 ST-3',
'vin': 'WF0GXXGCDGAL24730',
'year': 2010}
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA10%2520MJF%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [bca.uk] INFO: Saving data for MA10%20MJF: {'auction_closing_time': 1774778400.0, 'created_time': 1774478578.765189, 'last_price_update_time': 1774695764.510512}
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA10%2520MJF') HTTP/1.1" 204 0
2026-03-28 11:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:02:44 [bca.uk] INFO: Found listing with ID: BF18%20ZPB
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520ZPB%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [bca.uk] INFO: Scrape type for BF18%20ZPB: 1
2026-03-28 11:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a2d9cc75-bcde-5f91-a58f-521245e3769d with identifier: BF18%20ZPB
2026-03-28 11:02:44 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:02:44 [bca.uk] INFO: Found listing with ID: PX13%20OFM
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX13%2520OFM%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [bca.uk] INFO: Scrape type for PX13%20OFM: 0
2026-03-28 11:02:44 [bca.uk] INFO: Found listing with ID: C7%20WRJ
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C7%2520WRJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [bca.uk] INFO: Scrape type for C7%20WRJ: 0
2026-03-28 11:02:44 [bca.uk] INFO: Found listing with ID: SR68%20NWE
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520NWE%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [bca.uk] INFO: Scrape type for SR68%20NWE: 2
2026-03-28 11:02:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 71b07060-fab0-5284-a05c-e76ab465ab62 with identifier: SR68%20NWE
2026-03-28 11:02:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 71b07060-fab0-5284-a05c-e76ab465ab62 with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 71b07060-fab0-5284-a05c-e76ab465ab62 with scrape type 2
2026-03-28 11:02:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 71b07060-fab0-5284-a05c-e76ab465ab62, identifier: SR68%20NWE
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811782%27 HTTP/1.1" 200 None
2026-03-28 11:02:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811782 not downloaded yet
2026-03-28 11:02:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794324>
2026-03-28 11:02:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU05%20ZMV-GB>
2026-03-28 11:02:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 71b07060-fab0-5284-a05c-e76ab465ab62 with identifier: SR68%20NWE
2026-03-28 11:02:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 71b07060-fab0-5284-a05c-e76ab465ab62 with identifier: SR68%20NWE
2026-03-28 11:02:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 71b07060-fab0-5284-a05c-e76ab465ab62 with identifier: SR68%20NWE to the API
2026-03-28 11:02:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SR68%20NWE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '71b07060-fab0-5284-a05c-e76ab465ab62',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SR68 NWE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SR68%20NWE&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 29456,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D180 AWD S Hatchback',
'transmission': 'automatic',
'trim': 'D180 AWD S',
'vin': 'SADFA2AN8K1Z41968',
'year': 2019}
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520NWE%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [bca.uk] INFO: Saving data for SR68%20NWE: {'auction_closing_time': 1774778400.0, 'created_time': 1774476876.880445, 'last_price_update_time': 1774695765.14364}
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SR68%2520NWE') HTTP/1.1" 204 0
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe54310>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794328%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794328/600 saved to cache
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf7810>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787285%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787285/600 saved to cache
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9625d0>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662022%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662022/600 saved to cache
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec1390>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_expert_report_file_28a65092-d63e-4eef-991b-620a69a05764.pdf HTTP/1.1" 201 0
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2, skipping ID generation
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLP66TZU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LP66TZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac35c510>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787270%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787270/600 saved to cache
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe70090>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719483%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719483/600 saved to cache
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV70%20XPL-GB>
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787258>
2026-03-28 11:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:02:45 [bca.uk] INFO: Found listing with ID: BT62%20XMJ
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT62%2520XMJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [bca.uk] INFO: Scrape type for BT62%20XMJ: 1
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5bb8527-4699-5922-9d9e-bf80d1714c97 with identifier: BT62%20XMJ
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:02:45 [bca.uk] INFO: Found listing with ID: SG64%20KJZ
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG64%2520KJZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [bca.uk] INFO: Scrape type for SG64%20KJZ: 1
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1dc24d5-e7ba-51c0-bd83-ba297100a29a with identifier: SG64%20KJZ
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811804%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811804 not downloaded yet
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827881%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827881 not downloaded yet
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe7ab90>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794337%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794337/600 saved to cache
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:02:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822560>
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662019>
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD19%20ARF-GB>
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719470>
2026-03-28 11:02:45 [bca.uk] INFO: Found listing with ID: SV14%20VWC
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520VWC%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [bca.uk] INFO: Scrape type for SV14%20VWC: 2
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9331398c-8b45-57c9-9ff3-ccb21a2ab701 with identifier: SV14%20VWC
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9331398c-8b45-57c9-9ff3-ccb21a2ab701 with scrape type 2
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9331398c-8b45-57c9-9ff3-ccb21a2ab701 with scrape type 2
2026-03-28 11:02:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9331398c-8b45-57c9-9ff3-ccb21a2ab701, identifier: SV14%20VWC
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811830%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811830 not downloaded yet
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff61590>
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_expert_report_file_867d98ec-57dd-4bab-9d92-e6ff87b94c03.pdf HTTP/1.1" 201 0
2026-03-28 11:02:45 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fd76365-0d93-5f43-bb85-e0898d18c703, skipping ID generation
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMA66DBU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA66DBU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794315>
2026-03-28 11:02:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9331398c-8b45-57c9-9ff3-ccb21a2ab701 with identifier: SV14%20VWC
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:02:45 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=green HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:02:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9331398c-8b45-57c9-9ff3-ccb21a2ab701 with identifier: SV14%20VWC
2026-03-28 11:02:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9331398c-8b45-57c9-9ff3-ccb21a2ab701 with identifier: SV14%20VWC to the API
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV14%20VWC-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9331398c-8b45-57c9-9ff3-ccb21a2ab701',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV14 VWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV14%20VWC&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'SKODA',
'model': 'YETI OUTDOOR',
'odometer': 43645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'SKODA YETI OUTDOOR 2.0 TDI CR 140 ELEGANCE 4X4 DSG Estate',
'transmission': 'automatic',
'trim': 'TDI CR 140 ELEGANCE 4X4 DSG',
'vin': 'TMBMD75L2E6023740',
'year': 2014}
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520VWC%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [bca.uk] INFO: Saving data for SV14%20VWC: {'auction_closing_time': 1774778400.0, 'created_time': 1774476840.133154, 'last_price_update_time': 1774695766.461597}
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV14%2520VWC') HTTP/1.1" 204 0
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827884%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827884 not downloaded yet
2026-03-28 11:02:46 [bca.uk] INFO: Found listing with ID: FG60%20TLX
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG60%2520TLX%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [bca.uk] INFO: Scrape type for FG60%20TLX: 1
2026-03-28 11:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c with identifier: FG60%20TLX
2026-03-28 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811846%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811846 not downloaded yet
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827888%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827888 not downloaded yet
2026-03-28 11:02:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad18a5d0>
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822578%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822578/600 saved to cache
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=CK63ERY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY59%20LSX-GB>
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827891%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827891 not downloaded yet
2026-03-28 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:02:46 [bca.uk] INFO: Found listing with ID: NG65%20ETD
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG65%2520ETD%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [bca.uk] INFO: Scrape type for NG65%20ETD: 1
2026-03-28 11:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b688c5d-461a-59e2-96c9-84371012ae94 with identifier: NG65%20ETD
2026-03-28 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811870%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811870 not downloaded yet
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827896%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827896 not downloaded yet
2026-03-28 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827900%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827900 not downloaded yet
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feb0c10>
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_expert_report_file_68325829-7be7-4a62-9e9b-3c4c6e08b5df.pdf HTTP/1.1" 201 0
2026-03-28 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:02:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86c3d5ed-6b33-5aac-81cc-1442ec105e02, skipping ID generation
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEK58XAN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK58XAN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:46 [bca.uk] INFO: Found listing with ID: WV65%20EZL
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV65%2520EZL%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [bca.uk] INFO: Scrape type for WV65%20EZL: 2
2026-03-28 11:02:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64 with identifier: WV65%20EZL
2026-03-28 11:02:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64 with scrape type 2
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64 with scrape type 2
2026-03-28 11:02:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64, identifier: WV65%20EZL
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811895%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811895 not downloaded yet
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827901%27 HTTP/1.1" 200 None
2026-03-28 11:02:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827901 not downloaded yet
2026-03-28 11:02:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811782>
2026-03-28 11:02:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64 with identifier: WV65%20EZL
2026-03-28 11:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64 with identifier: WV65%20EZL
2026-03-28 11:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2c2cf67f-7dbb-5775-aa11-8c6ee4298d64 with identifier: WV65%20EZL to the API
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 245,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV65%20EZL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2c2cf67f-7dbb-5775-aa11-8c6ee4298d64',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV65 EZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV65%20EZL&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'MITSUBISHI',
'model': 'SHOGUN',
'odometer': 104422,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MITSUBISHI SHOGUN 3.2 DI-DC 187 SG3 StationWagon',
'transmission': 'automatic',
'trim': 'DI-DC 187 SG3',
'vin': 'JMALYV98WGJ600289',
'year': 2015}
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV65%2520EZL%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [bca.uk] INFO: Saving data for WV65%20EZL: {'auction_closing_time': 1774864800.0, 'created_time': 1774591805.43162, 'last_price_update_time': 1774695767.418302}
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV65%2520EZL') HTTP/1.1" 204 0
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827907%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827907 not downloaded yet
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781982%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781982 not downloaded yet
2026-03-28 11:02:47 [bca.uk] INFO: Found listing with ID: SA16%20NZY
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA16%2520NZY%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [bca.uk] INFO: Scrape type for SA16%20NZY: 0
2026-03-28 11:02:47 [bca.uk] INFO: Found listing with ID: SP14%20TRV
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520TRV%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [bca.uk] INFO: Scrape type for SP14%20TRV: 2
2026-03-28 11:02:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2b6efb-84a1-507f-9630-38a347482380 with identifier: SP14%20TRV
2026-03-28 11:02:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2b6efb-84a1-507f-9630-38a347482380 with scrape type 2
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2b6efb-84a1-507f-9630-38a347482380 with scrape type 2
2026-03-28 11:02:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a2b6efb-84a1-507f-9630-38a347482380, identifier: SP14%20TRV
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811922%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811922 not downloaded yet
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827905%27 HTTP/1.1" 200 None
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827905 not downloaded yet
2026-03-28 11:02:47 [bca.uk] INFO: Total items found: 100
2026-03-28 11:02:47 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded
2026-03-28 11:02:47 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:02:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a15d0>
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787258%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787258/600 saved to cache
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:47 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a8e10>
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794324%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794324/600 saved to cache
2026-03-28 11:02:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811804>
2026-03-28 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:02:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:02:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a2b6efb-84a1-507f-9630-38a347482380 with identifier: SP14%20TRV
2026-03-28 11:02:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a2b6efb-84a1-507f-9630-38a347482380 with identifier: SP14%20TRV
2026-03-28 11:02:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a2b6efb-84a1-507f-9630-38a347482380 with identifier: SP14%20TRV to the API
2026-03-28 11:02:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 175,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP14%20TRV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5a2b6efb-84a1-507f-9630-38a347482380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP14 TRV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP14%20TRV&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'KIA',
'model': 'SORENTO',
'odometer': 102773,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA SORENTO 2.2 CRDI KX-2 StationWagon',
'transmission': 'automatic',
'trim': 'CRDI KX-2',
'vin': 'KNAKU814SE5516828',
'year': 2014}
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP14%2520TRV%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [bca.uk] INFO: Saving data for SP14%20TRV: {'auction_closing_time': 1774864800.0, 'created_time': 1773929655.982771, 'last_price_update_time': 1774695768.173251}
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP14%2520TRV') HTTP/1.1" 204 0
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827917%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827917 not downloaded yet
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782009%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782009 not downloaded yet
2026-03-28 11:02:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:02:48 [bca.uk] INFO: Found listing with ID: WO15%20WBN
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [bca.uk] INFO: Scrape type for WO15%20WBN: 2
2026-03-28 11:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN
2026-03-28 11:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a6fac8f8-9ee3-53f7-8371-eb7661c850d1, identifier: WO15%20WBN
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811954%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811954 not downloaded yet
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827911%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827911 not downloaded yet
2026-03-28 11:02:48 [bca.uk] INFO: Found listing with ID: LM12%20BXG
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520BXG%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [bca.uk] INFO: Scrape type for LM12%20BXG: 2
2026-03-28 11:02:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf with identifier: LM12%20BXG
2026-03-28 11:02:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf with scrape type 2
2026-03-28 11:02:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf, identifier: LM12%20BXG
2026-03-28 11:02:48 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4173d0>
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_expert_report_file_af4e631a-c1e9-4ea8-9771-d661a9efadd3.pdf HTTP/1.1" 201 0
2026-03-28 11:02:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be8bbf41-9ce9-501b-87fe-5d2475363c5c, skipping ID generation
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHX68KXL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HX68KXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb18610>
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_expert_report_file_9ef6435f-43b9-424d-b2d3-1742a16e8cba.pdf HTTP/1.1" 201 0
2026-03-28 11:02:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:02:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6, skipping ID generation
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBJ66YWK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ66YWK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:48 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:48 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:48 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:48 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ead97d0>
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719470%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719470/600 saved to cache
2026-03-28 11:02:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:02:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN
2026-03-28 11:02:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN
2026-03-28 11:02:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a6fac8f8-9ee3-53f7-8371-eb7661c850d1 with identifier: WO15%20WBN to the API
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO15%20WBN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a6fac8f8-9ee3-53f7-8371-eb7661c850d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO15 WBN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WO15%20WBN&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'FIAT',
'model': '500X',
'odometer': 107624,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500X 1.6 M/JET 120 CROSS PLUS Hatchback',
'transmission': 'manual',
'trim': 'M/JET 120 CROSS PLUS',
'vin': 'ZFA3340000P358150',
'year': 2015}
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [bca.uk] INFO: Saving data for WO15%20WBN: {'auction_closing_time': 1774778400.0, 'created_time': 1774476301.899483, 'last_price_update_time': 1774695769.025437}
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WO15%2520WBN') HTTP/1.1" 204 0
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827925%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827925 not downloaded yet
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782032%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782032 not downloaded yet
2026-03-28 11:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf with identifier: LM12%20BXG
2026-03-28 11:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf with identifier: LM12%20BXG
2026-03-28 11:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf with identifier: LM12%20BXG to the API
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM12%20BXG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5a5a6e0-fc43-582b-9a29-8c098d1a1bdf',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM12 BXG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM12%20BXG&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 138011,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 ACENTA PREMIUM Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA PREMIUM',
'vin': 'SJNFBAF15U6215700',
'year': 2012}
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520BXG%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [bca.uk] INFO: Saving data for LM12%20BXG: {'auction_closing_time': 1774778400.0, 'created_time': 1774564591.422231, 'last_price_update_time': 1774695769.442569}
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM12%2520BXG') HTTP/1.1" 204 0
2026-03-28 11:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:02:49 [bca.uk] INFO: Found listing with ID: SK57%20HOJ
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK57%2520HOJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [bca.uk] INFO: Scrape type for SK57%20HOJ: 2
2026-03-28 11:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0616de5c-1420-5556-832c-efb828b74508 with identifier: SK57%20HOJ
2026-03-28 11:02:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0616de5c-1420-5556-832c-efb828b74508 with scrape type 2
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0616de5c-1420-5556-832c-efb828b74508 with scrape type 2
2026-03-28 11:02:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0616de5c-1420-5556-832c-efb828b74508, identifier: SK57%20HOJ
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811970%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811970 not downloaded yet
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827919%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827919 not downloaded yet
2026-03-28 11:02:49 [bca.uk] INFO: Found listing with ID: LV14%20AZO
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV14%2520AZO%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [bca.uk] INFO: Scrape type for LV14%20AZO: 1
2026-03-28 11:02:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a93f474b-9a84-5577-a127-e359e20b9ab5 with identifier: LV14%20AZO
2026-03-28 11:02:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740204%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740204 not downloaded yet
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811755%27 HTTP/1.1" 200 None
2026-03-28 11:02:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811755 not downloaded yet
2026-03-28 11:02:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827888>
2026-03-28 11:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827891/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827891>
2026-03-28 11:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG60%20TLX-GB>
2026-03-28 11:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827896>
2026-03-28 11:02:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811846/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811846>
2026-03-28 11:02:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0616de5c-1420-5556-832c-efb828b74508 with identifier: SK57%20HOJ
2026-03-28 11:02:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0616de5c-1420-5556-832c-efb828b74508 with identifier: SK57%20HOJ
2026-03-28 11:02:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0616de5c-1420-5556-832c-efb828b74508 with identifier: SK57%20HOJ to the API
2026-03-28 11:02:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK57%20HOJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0616de5c-1420-5556-832c-efb828b74508',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK57 HOJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK57%20HOJ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'HONDA',
'model': 'CR-V',
'odometer': 91426,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA CR-V 2.0 I-VTEC ES Estate',
'transmission': 'automatic',
'trim': 'I-VTEC ES',
'vin': 'SHSRE58507U030557',
'year': 2007}
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK57%2520HOJ%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [bca.uk] INFO: Saving data for SK57%20HOJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774591815.747145, 'last_price_update_time': 1774695770.478821}
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK57%2520HOJ') HTTP/1.1" 204 0
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827934%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827934 not downloaded yet
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782067%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782067 not downloaded yet
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8a8990>
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_expert_report_file_c54b27fb-3228-45f6-9d9d-2b443ab99b48.pdf HTTP/1.1" 201 0
2026-03-28 11:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb67be3a-90c8-5a60-a598-4f91805ebe76, skipping ID generation
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU05ZMV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU05ZMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe09110>
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_expert_report_file_84463669-9e1f-4582-99f2-b0a1acbbee35.pdf HTTP/1.1" 201 0
2026-03-28 11:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2e9e7ea-51b4-5374-8434-69f905958f69, skipping ID generation
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSV70XPL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV70XPL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec1210>
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822560%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822560/600 saved to cache
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea3aed0>
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662019%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662019/600 saved to cache
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe08050>
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_expert_report_file_b2026b99-13f3-4ff4-8dfa-fcc412c96e13.pdf HTTP/1.1" 201 0
2026-03-28 11:02:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:02:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9627a815-843b-5104-8c72-e08099ef2ec0, skipping ID generation
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD19ARF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD19ARF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:50 [bca.uk] INFO: Found listing with ID: SV12%20OCC
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV12%2520OCC%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [bca.uk] INFO: Scrape type for SV12%20OCC: 0
2026-03-28 11:02:50 [bca.uk] INFO: Found listing with ID: EA14%20MJV
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520MJV%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [bca.uk] INFO: Scrape type for EA14%20MJV: 0
2026-03-28 11:02:50 [bca.uk] INFO: Found listing with ID: EO61%20WGX
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520WGX%27 HTTP/1.1" 200 None
2026-03-28 11:02:50 [bca.uk] INFO: Scrape type for EO61%20WGX: 2
2026-03-28 11:02:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da with identifier: EO61%20WGX
2026-03-28 11:02:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da with scrape type 2
2026-03-28 11:02:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da, identifier: EO61%20WGX
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827927%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827927 not downloaded yet
2026-03-28 11:02:51 [bca.uk] INFO: Found listing with ID: AM09%20AHK
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM09%2520AHK%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [bca.uk] INFO: Scrape type for AM09%20AHK: 2
2026-03-28 11:02:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c2d1282-63b6-51d9-9431-4d78105e0559 with identifier: AM09%20AHK
2026-03-28 11:02:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2c2d1282-63b6-51d9-9431-4d78105e0559 with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2c2d1282-63b6-51d9-9431-4d78105e0559 with scrape type 2
2026-03-28 11:02:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2c2d1282-63b6-51d9-9431-4d78105e0559, identifier: AM09%20AHK
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740217%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740217 not downloaded yet
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811799%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811799 not downloaded yet
2026-03-28 11:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da with identifier: EO61%20WGX
2026-03-28 11:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da with identifier: EO61%20WGX
2026-03-28 11:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da with identifier: EO61%20WGX to the API
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 148,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO61%20WGX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c0b1ff9-a0b9-5b49-89f7-95dd1b08f5da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO61 WGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO61%20WGX&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'MERCEDES-BENZ',
'model': 'C180',
'odometer': 122067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C180 1.8 B/E SE EDITION 125 Saloon',
'transmission': 'manual',
'trim': 'B/E SE EDITION 125',
'vin': 'WDD2040492A645288',
'year': 2011}
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO61%2520WGX%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [bca.uk] INFO: Saving data for EO61%20WGX: {'auction_closing_time': 1774778400.0, 'created_time': 1774479843.469507, 'last_price_update_time': 1774695771.703847}
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO61%2520WGX') HTTP/1.1" 204 0
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827940%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827940 not downloaded yet
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782098%27 HTTP/1.1" 200 None
2026-03-28 11:02:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782098 not downloaded yet
2026-03-28 11:02:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2c2d1282-63b6-51d9-9431-4d78105e0559 with identifier: AM09%20AHK
2026-03-28 11:02:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2c2d1282-63b6-51d9-9431-4d78105e0559 with identifier: AM09%20AHK
2026-03-28 11:02:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2c2d1282-63b6-51d9-9431-4d78105e0559 with identifier: AM09%20AHK to the API
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 224,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AM09%20AHK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2c2d1282-63b6-51d9-9431-4d78105e0559',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AM09 AHK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AM09%20AHK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLVO',
'model': 'XC90',
'odometer': 141529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLVO XC90 2.4 D5 185 SE PREMIUM G/T Estate',
'transmission': 'manual',
'trim': 'D5 185 SE PREMIUM G/T',
'vin': 'YV1CZ7146A1538067',
'year': 2009}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AM09%2520AHK%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [bca.uk] INFO: Saving data for AM09%20AHK: {'auction_closing_time': 1774778400.0, 'created_time': 1774477963.505242, 'last_price_update_time': 1774695772.128614}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AM09%2520AHK') HTTP/1.1" 204 0
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799313%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799313 not downloaded yet
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811729%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811729 not downloaded yet
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811741%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811741 not downloaded yet
2026-03-28 11:02:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ad750>
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794315%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794315/600 saved to cache
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827905/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827905>
2026-03-28 11:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827901>
2026-03-28 11:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827907>
2026-03-28 11:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811922>
2026-03-28 11:02:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781982>
2026-03-28 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:02:52 [bca.uk] INFO: Found listing with ID: LO13%20ZTR
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [bca.uk] INFO: Scrape type for LO13%20ZTR: 2
2026-03-28 11:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57 with identifier: LO13%20ZTR
2026-03-28 11:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57, identifier: LO13%20ZTR
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827932%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827932 not downloaded yet
2026-03-28 11:02:52 [bca.uk] INFO: Found listing with ID: BD61%20ZJE
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD61%2520ZJE%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [bca.uk] INFO: Scrape type for BD61%20ZJE: 2
2026-03-28 11:02:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e891933-9cc3-5255-ae48-2ac5a7789c93 with identifier: BD61%20ZJE
2026-03-28 11:02:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e891933-9cc3-5255-ae48-2ac5a7789c93 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e891933-9cc3-5255-ae48-2ac5a7789c93 with scrape type 2
2026-03-28 11:02:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1e891933-9cc3-5255-ae48-2ac5a7789c93, identifier: BD61%20ZJE
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740228%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740228 not downloaded yet
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811822%27 HTTP/1.1" 200 None
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811822 not downloaded yet
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c0410>
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811727%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811727/600 saved to cache
2026-03-28 11:02:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811846/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:02:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57 with identifier: LO13%20ZTR
2026-03-28 11:02:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57 with identifier: LO13%20ZTR
2026-03-28 11:02:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57 with identifier: LO13%20ZTR to the API
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO13%20ZTR-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e786a1ca-1b65-5a9d-9bf3-e2554bb0fc57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO13 ZTR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO13%20ZTR&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 74773,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 16V 100 ENERGY Hatchback',
'transmission': 'manual',
'trim': '16V 100 ENERGY',
'vin': 'W0LPC6EB2D1117533',
'year': 2013}
2026-03-28 11:02:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Saving data for LO13%20ZTR: {'auction_closing_time': 1774778400.0, 'created_time': 1774476286.78263, 'last_price_update_time': 1774695773.010905}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO13%2520ZTR') HTTP/1.1" 204 0
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782131%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782131 not downloaded yet
2026-03-28 11:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1e891933-9cc3-5255-ae48-2ac5a7789c93 with identifier: BD61%20ZJE
2026-03-28 11:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1e891933-9cc3-5255-ae48-2ac5a7789c93 with identifier: BD61%20ZJE
2026-03-28 11:02:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1e891933-9cc3-5255-ae48-2ac5a7789c93 with identifier: BD61%20ZJE to the API
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD61%20ZJE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1e891933-9cc3-5255-ae48-2ac5a7789c93',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD61 ZJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD61%20ZJE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 107348,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.6 117 N-TEC+ Hatchback',
'transmission': 'manual',
'trim': '117 N-TEC+',
'vin': 'SJNFAAJ10U2429790',
'year': 2011}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD61%2520ZJE%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Saving data for BD61%20ZJE: {'auction_closing_time': 1774778400.0, 'created_time': 1774477965.277841, 'last_price_update_time': 1774695773.426184}
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD61%2520ZJE') HTTP/1.1" 204 0
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799315%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799315 not downloaded yet
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811743%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811743 not downloaded yet
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811783%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811783 not downloaded yet
2026-03-28 11:02:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e58ef50>
2026-03-28 11:02:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_expert_report_file_72dfc3c4-532b-4cfb-b136-aff60c3b19ea.pdf HTTP/1.1" 201 0
2026-03-28 11:02:53 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:02:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef4002b7-d31e-55a1-86f4-a46e5d38dc01, skipping ID generation
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKY59LSX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY59LSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:02:53 [bca.uk] INFO: Found listing with ID: NK63%20OGC
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK63%2520OGC%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Scrape type for NK63%20OGC: 0
2026-03-28 11:02:53 [bca.uk] INFO: Found listing with ID: RX57%20MKU
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX57%2520MKU%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Scrape type for RX57%20MKU: 0
2026-03-28 11:02:53 [bca.uk] INFO: Found listing with ID: SG11%20YNA
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520YNA%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Scrape type for SG11%20YNA: 0
2026-03-28 11:02:53 [bca.uk] INFO: Found listing with ID: SJ13%20HUH
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ13%2520HUH%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Scrape type for SJ13%20HUH: 2
2026-03-28 11:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8c81445-f658-566d-bba4-0b5b9edd4578 with identifier: SJ13%20HUH
2026-03-28 11:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8c81445-f658-566d-bba4-0b5b9edd4578 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8c81445-f658-566d-bba4-0b5b9edd4578 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f8c81445-f658-566d-bba4-0b5b9edd4578, identifier: SJ13%20HUH
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827938%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827938 not downloaded yet
2026-03-28 11:02:53 [bca.uk] INFO: Found listing with ID: DV60%20UEY
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV60%2520UEY%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [bca.uk] INFO: Scrape type for DV60%20UEY: 2
2026-03-28 11:02:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bc38e796-c44f-52c4-913a-866ffe6a0c14 with identifier: DV60%20UEY
2026-03-28 11:02:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bc38e796-c44f-52c4-913a-866ffe6a0c14 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bc38e796-c44f-52c4-913a-866ffe6a0c14 with scrape type 2
2026-03-28 11:02:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bc38e796-c44f-52c4-913a-866ffe6a0c14, identifier: DV60%20UEY
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740238%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740238 not downloaded yet
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811842%27 HTTP/1.1" 200 None
2026-03-28 11:02:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811842 not downloaded yet
2026-03-28 11:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811755>
2026-03-28 11:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827925>
2026-03-28 11:02:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782032>
2026-03-28 11:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827891/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:02:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:02:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f8c81445-f658-566d-bba4-0b5b9edd4578 with identifier: SJ13%20HUH
2026-03-28 11:02:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f8c81445-f658-566d-bba4-0b5b9edd4578 with identifier: SJ13%20HUH
2026-03-28 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f8c81445-f658-566d-bba4-0b5b9edd4578 with identifier: SJ13%20HUH to the API
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ13%20HUH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f8c81445-f658-566d-bba4-0b5b9edd4578',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ13 HUH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ13%20HUH&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 125699,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 0.9 TCE 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 DYNAMIQUE',
'vin': 'VF15R5A0H48611919',
'year': 2013}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ13%2520HUH%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [bca.uk] INFO: Saving data for SJ13%20HUH: {'auction_closing_time': 1774778400.0, 'created_time': 1774478302.92611, 'last_price_update_time': 1774695774.316994}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ13%2520HUH') HTTP/1.1" 204 0
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782160%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782160 not downloaded yet
2026-03-28 11:02:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bc38e796-c44f-52c4-913a-866ffe6a0c14 with identifier: DV60%20UEY
2026-03-28 11:02:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bc38e796-c44f-52c4-913a-866ffe6a0c14 with identifier: DV60%20UEY
2026-03-28 11:02:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bc38e796-c44f-52c4-913a-866ffe6a0c14 with identifier: DV60%20UEY to the API
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 167,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DV60%20UEY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bc38e796-c44f-52c4-913a-866ffe6a0c14',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DV60 UEY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DV60%20UEY&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 122705,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 ELITE Hatchback',
'transmission': 'automatic',
'trim': '16V 115 ELITE',
'vin': 'W0LPE6ED1B8019030',
'year': 2010}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV60%2520UEY%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [bca.uk] INFO: Saving data for DV60%20UEY: {'auction_closing_time': 1774778400.0, 'created_time': 1774476466.974946, 'last_price_update_time': 1774695774.800984}
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DV60%2520UEY') HTTP/1.1" 204 0
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799320%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799320 not downloaded yet
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811754%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811754 not downloaded yet
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811832%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811832 not downloaded yet
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931527%27 HTTP/1.1" 200 None
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931527 not downloaded yet
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac280fd0>
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811804%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811804/600 saved to cache
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c3190>
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811782%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811782/600 saved to cache
2026-03-28 11:02:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:02:54 [bca.uk] INFO: Found listing with ID: SN11%20HLZ
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN11%2520HLZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [bca.uk] INFO: Scrape type for SN11%20HLZ: 2
2026-03-28 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ff798a4-422d-53a3-afd2-5a0057c3aafb with identifier: SN11%20HLZ
2026-03-28 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ff798a4-422d-53a3-afd2-5a0057c3aafb with scrape type 2
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ff798a4-422d-53a3-afd2-5a0057c3aafb with scrape type 2
2026-03-28 11:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ff798a4-422d-53a3-afd2-5a0057c3aafb, identifier: SN11%20HLZ
2026-03-28 11:02:55 [bca.uk] INFO: Found listing with ID: EA58%20FEF
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA58%2520FEF%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [bca.uk] INFO: Scrape type for EA58%20FEF: 1
2026-03-28 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d639b99c-69a4-57a3-aa72-b8c531763c23 with identifier: EA58%20FEF
2026-03-28 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740253%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740253 not downloaded yet
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811863%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811863 not downloaded yet
2026-03-28 11:02:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5cd2d0>
2026-03-28 11:02:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811846%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811846/600 saved to cache
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ff798a4-422d-53a3-afd2-5a0057c3aafb with identifier: SN11%20HLZ
2026-03-28 11:02:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ff798a4-422d-53a3-afd2-5a0057c3aafb with identifier: SN11%20HLZ
2026-03-28 11:02:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ff798a4-422d-53a3-afd2-5a0057c3aafb with identifier: SN11%20HLZ to the API
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN11%20HLZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2ff798a4-422d-53a3-afd2-5a0057c3aafb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN11 HLZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN11%20HLZ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 78241,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 110 SPORT Hatchback',
'transmission': 'manual',
'trim': 'TDCI 110 SPORT',
'vin': 'WF0PXXWPDPBD29943',
'year': 2011}
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN11%2520HLZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [bca.uk] INFO: Saving data for SN11%20HLZ: {'auction_closing_time': 1774778400.0, 'created_time': 1774478291.442981, 'last_price_update_time': 1774695775.668296}
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN11%2520HLZ') HTTP/1.1" 204 0
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782190%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782190 not downloaded yet
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799325%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799325 not downloaded yet
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811792%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811792 not downloaded yet
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811855%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811855 not downloaded yet
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931529%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931529 not downloaded yet
2026-03-28 11:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811799/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811799>
2026-03-28 11:02:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740217>
2026-03-28 11:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827905/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:02:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:02:55 [bca.uk] INFO: Found listing with ID: WK61%20WML
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520WML%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [bca.uk] INFO: Scrape type for WK61%20WML: 0
2026-03-28 11:02:55 [bca.uk] INFO: Found listing with ID: EK19%20ZSU
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK19%2520ZSU%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [bca.uk] INFO: Scrape type for EK19%20ZSU: 0
2026-03-28 11:02:55 [bca.uk] INFO: Found listing with ID: YD08%20FXX
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD08%2520FXX%27 HTTP/1.1" 200 None
2026-03-28 11:02:55 [bca.uk] INFO: Scrape type for YD08%20FXX: 2
2026-03-28 11:02:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 62b105d6-5481-5eef-81dd-846bc6d0c3d1 with identifier: YD08%20FXX
2026-03-28 11:02:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 62b105d6-5481-5eef-81dd-846bc6d0c3d1 with scrape type 2
2026-03-28 11:02:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 62b105d6-5481-5eef-81dd-846bc6d0c3d1 with scrape type 2
2026-03-28 11:02:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 62b105d6-5481-5eef-81dd-846bc6d0c3d1, identifier: YD08%20FXX
2026-03-28 11:02:55 [bca.uk] INFO: Found listing with ID: MV19%20XLX
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520XLX%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for MV19%20XLX: 0
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: AO71%20FNZ
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520FNZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for AO71%20FNZ: 0
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: KS70%20JKZ
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS70%2520JKZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for KS70%20JKZ: 0
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: KY72%20BKX
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY72%2520BKX%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for KY72%20BKX: 0
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: RO18%20ZFF
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO18%2520ZFF%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for RO18%20ZFF: 0
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: WG21%20DFZ
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG21%2520DFZ%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for WG21%20DFZ: 0
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: EA64%20XMM
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520XMM%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for EA64%20XMM: 1
2026-03-28 11:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 02262c2b-f1a0-5da9-a14b-188ea3983135 with identifier: EA64%20XMM
2026-03-28 11:02:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740288%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740288 not downloaded yet
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811888%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811888 not downloaded yet
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea98bd0>
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827896%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827896/600 saved to cache
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e583810>
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827891%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827891/600 saved to cache
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c6150>
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827888%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827888/600 saved to cache
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811741>
2026-03-28 11:02:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:02:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 62b105d6-5481-5eef-81dd-846bc6d0c3d1 with identifier: YD08%20FXX
2026-03-28 11:02:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 62b105d6-5481-5eef-81dd-846bc6d0c3d1 with identifier: YD08%20FXX
2026-03-28 11:02:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 62b105d6-5481-5eef-81dd-846bc6d0c3d1 with identifier: YD08%20FXX to the API
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 288,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YD08%20FXX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '62b105d6-5481-5eef-81dd-846bc6d0c3d1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YD08 FXX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YD08%20FXX&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'PORSCHE',
'model': '911',
'odometer': 37040,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'PORSCHE 911 3.8 CARRERA S (997) Coupe',
'transmission': 'manual',
'trim': 'CARRERA S (997)',
'vin': 'WP0ZZZ99Z8S722709',
'year': 2008}
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD08%2520FXX%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Saving data for YD08%20FXX: {'auction_closing_time': 1774778400.0, 'created_time': 1773958826.73223, 'last_price_update_time': 1774695776.657053}
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YD08%2520FXX') HTTP/1.1" 204 0
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782223%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782223 not downloaded yet
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799328%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799328 not downloaded yet
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811818%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811818 not downloaded yet
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811866%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811866 not downloaded yet
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931530%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931530 not downloaded yet
2026-03-28 11:02:56 [bca.uk] INFO: Found listing with ID: NA14%20XFF
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520XFF%27 HTTP/1.1" 200 None
2026-03-28 11:02:56 [bca.uk] INFO: Scrape type for NA14%20XFF: 2
2026-03-28 11:02:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 77c952e0-86f6-5426-8a11-2ce1de0034f3 with identifier: NA14%20XFF
2026-03-28 11:02:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 77c952e0-86f6-5426-8a11-2ce1de0034f3 with scrape type 2
2026-03-28 11:02:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 77c952e0-86f6-5426-8a11-2ce1de0034f3 with scrape type 2
2026-03-28 11:02:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 77c952e0-86f6-5426-8a11-2ce1de0034f3, identifier: NA14%20XFF
2026-03-28 11:02:57 [bca.uk] INFO: Found listing with ID: EO72%20HNA
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO72%2520HNA%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [bca.uk] INFO: Scrape type for EO72%20HNA: 1
2026-03-28 11:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c8cde9ac-9d88-54f8-905e-7cf70598e233 with identifier: EO72%20HNA
2026-03-28 11:02:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740315%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740315 not downloaded yet
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811924%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811924 not downloaded yet
2026-03-28 11:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KY59LSX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811783>
2026-03-28 11:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:02:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 77c952e0-86f6-5426-8a11-2ce1de0034f3 with identifier: NA14%20XFF
2026-03-28 11:02:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 77c952e0-86f6-5426-8a11-2ce1de0034f3 with identifier: NA14%20XFF
2026-03-28 11:02:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 77c952e0-86f6-5426-8a11-2ce1de0034f3 with identifier: NA14%20XFF to the API
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NA14%20XFF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '77c952e0-86f6-5426-8a11-2ce1de0034f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NA14 XFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NA14%20XFF&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'BMW',
'model': '520I',
'odometer': 108452,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 520I 2.0 SE STEP Saloon',
'transmission': 'automatic',
'trim': 'SE STEP',
'vin': 'WBA5A32040D197245',
'year': 2014}
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520XFF%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [bca.uk] INFO: Saving data for NA14%20XFF: {'auction_closing_time': 1774864800.0, 'created_time': 1774305713.460761, 'last_price_update_time': 1774695777.46806}
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NA14%2520XFF') HTTP/1.1" 204 0
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799331%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799331 not downloaded yet
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811844%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811844 not downloaded yet
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811897%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811897 not downloaded yet
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931531%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931531 not downloaded yet
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d0b10>
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698781982%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781982/600 saved to cache
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e609dd0>
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827905%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827905/600 saved to cache
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb89190>
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827901%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827901/600 saved to cache
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb1abd0>
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827907%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827907/600 saved to cache
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:02:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811842>
2026-03-28 11:02:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811743/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811743>
2026-03-28 11:02:57 [bca.uk] INFO: Found listing with ID: GU66%20BFA
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU66%2520BFA%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [bca.uk] INFO: Scrape type for GU66%20BFA: 0
2026-03-28 11:02:57 [bca.uk] INFO: Found listing with ID: MF19%20OFT
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520OFT%27 HTTP/1.1" 200 None
2026-03-28 11:02:57 [bca.uk] INFO: Scrape type for MF19%20OFT: 2
2026-03-28 11:02:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e01e20d4-bffc-542b-bfcd-28abd844c891 with identifier: MF19%20OFT
2026-03-28 11:02:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e01e20d4-bffc-542b-bfcd-28abd844c891 with scrape type 2
2026-03-28 11:02:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e01e20d4-bffc-542b-bfcd-28abd844c891 with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e01e20d4-bffc-542b-bfcd-28abd844c891, identifier: MF19%20OFT
2026-03-28 11:02:58 [bca.uk] INFO: Found listing with ID: EY04%20UCF
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY04%2520UCF%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [bca.uk] INFO: Scrape type for EY04%20UCF: 2
2026-03-28 11:02:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: db68abca-62f7-588f-9d07-a80509e317fd with identifier: EY04%20UCF
2026-03-28 11:02:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item db68abca-62f7-588f-9d07-a80509e317fd with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item db68abca-62f7-588f-9d07-a80509e317fd with scrape type 2
2026-03-28 11:02:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: db68abca-62f7-588f-9d07-a80509e317fd, identifier: EY04%20UCF
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740356%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740356 not downloaded yet
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811948%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811948 not downloaded yet
2026-03-28 11:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e01e20d4-bffc-542b-bfcd-28abd844c891 with identifier: MF19%20OFT
2026-03-28 11:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e01e20d4-bffc-542b-bfcd-28abd844c891 with identifier: MF19%20OFT
2026-03-28 11:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e01e20d4-bffc-542b-bfcd-28abd844c891 with identifier: MF19%20OFT to the API
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF19%20OFT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e01e20d4-bffc-542b-bfcd-28abd844c891',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF19 OFT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF19%20OFT&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 118179,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.5 BLUEHDI 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 130 ALLURE EAT8',
'vin': 'VF3MCYHZRKS137942',
'year': 2019}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF19%2520OFT%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [bca.uk] INFO: Saving data for MF19%20OFT: {'auction_closing_time': 1774864800.0, 'created_time': 1774504919.464918, 'last_price_update_time': 1774695778.565665}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF19%2520OFT') HTTP/1.1" 204 0
2026-03-28 11:02:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: db68abca-62f7-588f-9d07-a80509e317fd with identifier: EY04%20UCF
2026-03-28 11:02:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: db68abca-62f7-588f-9d07-a80509e317fd with identifier: EY04%20UCF
2026-03-28 11:02:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: db68abca-62f7-588f-9d07-a80509e317fd with identifier: EY04%20UCF to the API
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY04%20UCF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'db68abca-62f7-588f-9d07-a80509e317fd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY04 UCF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY04%20UCF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 101219,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 LX Hatchback',
'transmission': 'manual',
'trim': 'LX',
'vin': 'WF0HXXGAJH4B71293',
'year': 2004}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY04%2520UCF%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [bca.uk] INFO: Saving data for EY04%20UCF: {'auction_closing_time': 1774951200.0, 'created_time': 1774523378.068143, 'last_price_update_time': 1774695778.907596}
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY04%2520UCF') HTTP/1.1" 204 0
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799334%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799334 not downloaded yet
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811875%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811875 not downloaded yet
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811923%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811923 not downloaded yet
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931532%27 HTTP/1.1" 200 None
2026-03-28 11:02:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931532 not downloaded yet
2026-03-28 11:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811799/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740253/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740253>
2026-03-28 11:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811863/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811863>
2026-03-28 11:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA58%20FEF-GB>
2026-03-28 11:02:59 [bca.uk] INFO: Found listing with ID: FX65%20SEY
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX65%2520SEY%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [bca.uk] INFO: Scrape type for FX65%20SEY: 0
2026-03-28 11:02:59 [bca.uk] INFO: Found listing with ID: FV61%20BCF
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520BCF%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [bca.uk] INFO: Scrape type for FV61%20BCF: 2
2026-03-28 11:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263 with identifier: FV61%20BCF
2026-03-28 11:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263 with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263 with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263, identifier: FV61%20BCF
2026-03-28 11:02:59 [bca.uk] INFO: Found listing with ID: GT18%20AWT
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GT18%2520AWT%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [bca.uk] INFO: Scrape type for GT18%20AWT: 2
2026-03-28 11:02:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c3865f93-6faf-5621-a1d1-b8975d7a8aef with identifier: GT18%20AWT
2026-03-28 11:02:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c3865f93-6faf-5621-a1d1-b8975d7a8aef with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c3865f93-6faf-5621-a1d1-b8975d7a8aef with scrape type 2
2026-03-28 11:02:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c3865f93-6faf-5621-a1d1-b8975d7a8aef, identifier: GT18%20AWT
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698740383%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740383 not downloaded yet
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811968%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811968 not downloaded yet
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe86790>
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811922%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811922/600 saved to cache
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8daf50>
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782032%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782032/600 saved to cache
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdfbd50>
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811755%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811755/600 saved to cache
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:02:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac48f350>
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:02:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827925%252F600') HTTP/1.1" 204 0
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827925/600 saved to cache
2026-03-28 11:02:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811783/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:02:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931529/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931529>
2026-03-28 11:02:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263 with identifier: FV61%20BCF
2026-03-28 11:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263 with identifier: FV61%20BCF
2026-03-28 11:02:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263 with identifier: FV61%20BCF to the API
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:02:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FV61%20BCF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9ee405c3-e8df-5ef3-ab5d-2c7ea9aa2263',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FV61 BCF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FV61%20BCF&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'KIA',
'model': 'RIO',
'odometer': 106788,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA RIO 1.2 2 Hatchback',
'transmission': 'manual',
'trim': '2',
'vin': 'KNADN511LC6004469',
'year': 2011}
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV61%2520BCF%27 HTTP/1.1" 200 None
2026-03-28 11:02:59 [bca.uk] INFO: Saving data for FV61%20BCF: {'auction_closing_time': 1774778400.0, 'created_time': 1774476487.107247, 'last_price_update_time': 1774695779.970433}
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:02:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FV61%2520BCF') HTTP/1.1" 204 0
2026-03-28 11:02:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c3865f93-6faf-5621-a1d1-b8975d7a8aef with identifier: GT18%20AWT
2026-03-28 11:02:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c3865f93-6faf-5621-a1d1-b8975d7a8aef with identifier: GT18%20AWT
2026-03-28 11:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c3865f93-6faf-5621-a1d1-b8975d7a8aef with identifier: GT18%20AWT to the API
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GT18%20AWT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c3865f93-6faf-5621-a1d1-b8975d7a8aef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GT18 AWT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GT18%20AWT&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 45793,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TSI 230 GTI DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 230 GTI DSG',
'vin': 'WVWZZZAUZJW178006',
'year': 2018}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GT18%2520AWT%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [bca.uk] INFO: Saving data for GT18%20AWT: {'auction_closing_time': 1774778400.0, 'created_time': 1774448318.141522, 'last_price_update_time': 1774695780.372118}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GT18%2520AWT') HTTP/1.1" 204 0
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698799337%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799337 not downloaded yet
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811902%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811902 not downloaded yet
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811953%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811953 not downloaded yet
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931544%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931544 not downloaded yet
2026-03-28 11:03:00 [bca.uk] INFO: Found listing with ID: SF63%20YSY
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF63%2520YSY%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [bca.uk] INFO: Scrape type for SF63%20YSY: 2
2026-03-28 11:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d9d528a-f3e7-58a5-b53e-60d38908890e with identifier: SF63%20YSY
2026-03-28 11:03:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d9d528a-f3e7-58a5-b53e-60d38908890e with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d9d528a-f3e7-58a5-b53e-60d38908890e with scrape type 2
2026-03-28 11:03:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5d9d528a-f3e7-58a5-b53e-60d38908890e, identifier: SF63%20YSY
2026-03-28 11:03:00 [bca.uk] INFO: Found listing with ID: LT12%20OGV
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT12%2520OGV%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [bca.uk] INFO: Scrape type for LT12%20OGV: 1
2026-03-28 11:03:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1827e19-d691-5b45-bd7b-2374a12925ba with identifier: LT12%20OGV
2026-03-28 11:03:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811743/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:03:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811866>
2026-03-28 11:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931530>
2026-03-28 11:03:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811818>
2026-03-28 11:03:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5d9d528a-f3e7-58a5-b53e-60d38908890e with identifier: SF63%20YSY
2026-03-28 11:03:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5d9d528a-f3e7-58a5-b53e-60d38908890e with identifier: SF63%20YSY
2026-03-28 11:03:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5d9d528a-f3e7-58a5-b53e-60d38908890e with identifier: SF63%20YSY to the API
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF63%20YSY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5d9d528a-f3e7-58a5-b53e-60d38908890e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF63 YSY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SF63%20YSY&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 101500,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.6 TDI 105 SE Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 SE',
'vin': 'WAUZZZ8V5EA041062',
'year': 2013}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF63%2520YSY%27 HTTP/1.1" 200 None
2026-03-28 11:03:00 [bca.uk] INFO: Saving data for SF63%20YSY: {'auction_closing_time': 1774778400.0, 'created_time': 1774479793.160199, 'last_price_update_time': 1774695780.984985}
2026-03-28 11:03:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SF63%2520YSY') HTTP/1.1" 204 0
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811926%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811926 not downloaded yet
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811971%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811971 not downloaded yet
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931550%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931550 not downloaded yet
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac10c490>
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_expert_report_file_4688a291-4904-4707-be91-aeb6d2d589d4.pdf HTTP/1.1" 201 0
2026-03-28 11:03:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c, skipping ID generation
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFG60TLX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG60TLX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1e290>
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811799%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811799/600 saved to cache
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea16110>
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740217%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740217/600 saved to cache
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:03:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811924>
2026-03-28 11:03:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:03:01 [bca.uk] INFO: Found listing with ID: WJ60%20CFP
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520CFP%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [bca.uk] INFO: Scrape type for WJ60%20CFP: 2
2026-03-28 11:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dae1a3ba-74da-5d14-a64a-b8127f5f99d9 with identifier: WJ60%20CFP
2026-03-28 11:03:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dae1a3ba-74da-5d14-a64a-b8127f5f99d9 with scrape type 2
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dae1a3ba-74da-5d14-a64a-b8127f5f99d9 with scrape type 2
2026-03-28 11:03:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dae1a3ba-74da-5d14-a64a-b8127f5f99d9, identifier: WJ60%20CFP
2026-03-28 11:03:01 [bca.uk] INFO: Found listing with ID: LX64%20OPJ
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX64%2520OPJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [bca.uk] INFO: Scrape type for LX64%20OPJ: 1
2026-03-28 11:03:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af8b5473-208a-5762-a7c8-46860203893d with identifier: LX64%20OPJ
2026-03-28 11:03:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dae1a3ba-74da-5d14-a64a-b8127f5f99d9 with identifier: WJ60%20CFP
2026-03-28 11:03:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dae1a3ba-74da-5d14-a64a-b8127f5f99d9 with identifier: WJ60%20CFP
2026-03-28 11:03:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dae1a3ba-74da-5d14-a64a-b8127f5f99d9 with identifier: WJ60%20CFP to the API
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ60%20CFP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dae1a3ba-74da-5d14-a64a-b8127f5f99d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ60 CFP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ60%20CFP&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 177431,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I TR MMT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I TR MMT',
'vin': 'VNKKH96340A149391',
'year': 2010}
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ60%2520CFP%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [bca.uk] INFO: Saving data for WJ60%20CFP: {'auction_closing_time': 1774778400.0, 'created_time': 1774564596.516974, 'last_price_update_time': 1774695781.774574}
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ60%2520CFP') HTTP/1.1" 204 0
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931560%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931560 not downloaded yet
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818522%27 HTTP/1.1" 200 None
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818522 not downloaded yet
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42e290>
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811783%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811783/600 saved to cache
2026-03-28 11:03:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff950d0>
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811741%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811741/600 saved to cache
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931529/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811948>
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740356>
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740253/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811863/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: YG12%20VBZ
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG12%2520VBZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for YG12%20VBZ: 1
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6b7b4b43-f12a-505e-9392-e6bcd682c164 with identifier: YG12%20VBZ
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: AK08%20XKO
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK08%2520XKO%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for AK08%20XKO: 1
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b with identifier: AK08%20XKO
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e565c50>
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811743%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811743/600 saved to cache
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5cf850>
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931526%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931526/600 saved to cache
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931532>
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811923>
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697931567%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931567 not downloaded yet
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818536%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818536 not downloaded yet
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: YX63%20FCC
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520FCC%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for YX63%20FCC: 2
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7d4319a-d4d4-5817-9ba3-79f1868f82ac with identifier: YX63%20FCC
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7d4319a-d4d4-5817-9ba3-79f1868f82ac with scrape type 2
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7d4319a-d4d4-5817-9ba3-79f1868f82ac with scrape type 2
2026-03-28 11:03:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7d4319a-d4d4-5817-9ba3-79f1868f82ac, identifier: YX63%20FCC
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: LD56%20WYJ
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD56%2520WYJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for LD56%20WYJ: 1
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb with identifier: LD56%20WYJ
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e98d890>
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811842%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811842/600 saved to cache
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:03:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7d4319a-d4d4-5817-9ba3-79f1868f82ac with identifier: YX63%20FCC
2026-03-28 11:03:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7d4319a-d4d4-5817-9ba3-79f1868f82ac with identifier: YX63%20FCC
2026-03-28 11:03:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7d4319a-d4d4-5817-9ba3-79f1868f82ac with identifier: YX63%20FCC to the API
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YX63%20FCC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a7d4319a-d4d4-5817-9ba3-79f1868f82ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YX63 FCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YX63%20FCC&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 27874,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'MALAN51CLEM498896',
'year': 2013}
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520FCC%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Saving data for YX63%20FCC: {'auction_closing_time': 1774778400.0, 'created_time': 1774275193.325307, 'last_price_update_time': 1774695782.763056}
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YX63%2520FCC') HTTP/1.1" 204 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818544%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818544 not downloaded yet
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931544>
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811953>
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:03:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: AK65%20GFO
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK65%2520GFO%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for AK65%20GFO: 0
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: DG64%20YKK
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG64%2520YKK%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for DG64%20YKK: 0
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: DV68%20LFL
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV68%2520LFL%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for DV68%20LFL: 0
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: SK18%20JKO
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK18%2520JKO%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for SK18%20JKO: 1
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3f73c621-a26f-5e74-976e-c93fdd575bad with identifier: SK18%20JKO
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:02 [bca.uk] INFO: Found listing with ID: LR10%20UYM
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR10%2520UYM%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [bca.uk] INFO: Scrape type for LR10%20UYM: 1
2026-03-28 11:03:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c with identifier: LR10%20UYM
2026-03-28 11:03:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:03:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT12%20OGV-GB>
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818550%27 HTTP/1.1" 200 None
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818550 not downloaded yet
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa7710>
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931529%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931529/600 saved to cache
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e906c10>
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740253%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740253/600 saved to cache
2026-03-28 11:03:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea6f50>
2026-03-28 11:03:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811863%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811863/600 saved to cache
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: SP70%20LPC
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP70%2520LPC%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for SP70%20LPC: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: PO68%20KXK
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO68%2520KXK%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for PO68%20KXK: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: SE64%20GDF
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE64%2520GDF%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for SE64%20GDF: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: SH15%20NPX
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH15%2520NPX%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for SH15%20NPX: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: SL14%20FUV
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL14%2520FUV%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for SL14%20FUV: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: ST65%20BKF
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST65%2520BKF%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for ST65%20BKF: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: DX17%20SYH
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX17%2520SYH%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for DX17%20SYH: 0
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: SC17%20XRM
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC17%2520XRM%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for SC17%20XRM: 2
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 22859857-a6e7-500a-b1d3-b4e74bc43fd9 with identifier: SC17%20XRM
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 22859857-a6e7-500a-b1d3-b4e74bc43fd9 with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 22859857-a6e7-500a-b1d3-b4e74bc43fd9 with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 22859857-a6e7-500a-b1d3-b4e74bc43fd9, identifier: SC17%20XRM
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: NJ10%20LNA
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ10%2520LNA%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for NJ10%20LNA: 1
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c46ed1ba-1db0-5976-a700-17645579f4fb with identifier: NJ10%20LNA
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 22859857-a6e7-500a-b1d3-b4e74bc43fd9 with identifier: SC17%20XRM
2026-03-28 11:03:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 22859857-a6e7-500a-b1d3-b4e74bc43fd9 with identifier: SC17%20XRM
2026-03-28 11:03:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 22859857-a6e7-500a-b1d3-b4e74bc43fd9 with identifier: SC17%20XRM to the API
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC17%20XRM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '22859857-a6e7-500a-b1d3-b4e74bc43fd9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC17 XRM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC17%20XRM&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'INSIGNIA',
'odometer': 35208,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA 1.6 CDTI 136 SRI VX-LINE S/S Hatchback',
'transmission': 'manual',
'trim': 'CDTI 136 SRI VX-LINE S/S',
'vin': 'W0LGS6E31H1074305',
'year': 2017}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC17%2520XRM%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Saving data for SC17%20XRM: {'auction_closing_time': 1774778400.0, 'created_time': 1774476862.237362, 'last_price_update_time': 1774695783.652976}
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC17%2520XRM') HTTP/1.1" 204 0
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818555%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818555 not downloaded yet
2026-03-28 11:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931550>
2026-03-28 11:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX64%20OPJ-GB>
2026-03-28 11:03:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FG60TLX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: SD67%20KLC
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520KLC%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for SD67%20KLC: 2
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 215a267f-b871-5491-a974-28d825a69971 with identifier: SD67%20KLC
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 215a267f-b871-5491-a974-28d825a69971 with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 215a267f-b871-5491-a974-28d825a69971 with scrape type 2
2026-03-28 11:03:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 215a267f-b871-5491-a974-28d825a69971, identifier: SD67%20KLC
2026-03-28 11:03:03 [bca.uk] INFO: Found listing with ID: RY55%20ZKD
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY55%2520ZKD%27 HTTP/1.1" 200 None
2026-03-28 11:03:03 [bca.uk] INFO: Scrape type for RY55%20ZKD: 1
2026-03-28 11:03:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9d413d90-c345-553a-b38f-78ab8e1be9c8 with identifier: RY55%20ZKD
2026-03-28 11:03:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:03:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae788150>
2026-03-28 11:03:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_expert_report_file_e8faa6cf-91e6-4140-85ab-3d5c04204c6f.pdf HTTP/1.1" 201 0
2026-03-28 11:03:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d639b99c-69a4-57a3-aa72-b8c531763c23, skipping ID generation
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEA58FEF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA58FEF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24e350>
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931530%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931530/600 saved to cache
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e821310>
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811866%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811866/600 saved to cache
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb96f10>
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811818%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811818/600 saved to cache
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:03:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 215a267f-b871-5491-a974-28d825a69971 with identifier: SD67%20KLC
2026-03-28 11:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 215a267f-b871-5491-a974-28d825a69971 with identifier: SD67%20KLC
2026-03-28 11:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 215a267f-b871-5491-a974-28d825a69971 with identifier: SD67%20KLC to the API
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD67%20KLC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '215a267f-b871-5491-a974-28d825a69971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD67 KLC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD67%20KLC&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 42530,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 0.9 TCE 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 DYNAMIQUE',
'vin': 'VF12RA51558387238',
'year': 2017}
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520KLC%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [bca.uk] INFO: Saving data for SD67%20KLC: {'auction_closing_time': 1774778400.0, 'created_time': 1774563801.69748, 'last_price_update_time': 1774695784.503549}
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD67%2520KLC') HTTP/1.1" 204 0
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818563%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818563 not downloaded yet
2026-03-28 11:03:04 [bca.uk] INFO: Found listing with ID: KP65%20NNV
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520NNV%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [bca.uk] INFO: Scrape type for KP65%20NNV: 1
2026-03-28 11:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: baefc678-d212-5082-a8e0-52e336dc5403 with identifier: KP65%20NNV
2026-03-28 11:03:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:04 [bca.uk] INFO: Found listing with ID: KS69%20YXO
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YXO%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [bca.uk] INFO: Scrape type for KS69%20YXO: 2
2026-03-28 11:03:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3e7210f7-8600-5df0-9988-597281f442a2 with identifier: KS69%20YXO
2026-03-28 11:03:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3e7210f7-8600-5df0-9988-597281f442a2 with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3e7210f7-8600-5df0-9988-597281f442a2 with scrape type 2
2026-03-28 11:03:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3e7210f7-8600-5df0-9988-597281f442a2, identifier: KS69%20YXO
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801886%27 HTTP/1.1" 200 None
2026-03-28 11:03:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801886 not downloaded yet
2026-03-28 11:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD56%20WYJ-GB>
2026-03-28 11:03:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818544>
2026-03-28 11:03:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3e7210f7-8600-5df0-9988-597281f442a2 with identifier: KS69%20YXO
2026-03-28 11:03:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3e7210f7-8600-5df0-9988-597281f442a2 with identifier: KS69%20YXO
2026-03-28 11:03:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3e7210f7-8600-5df0-9988-597281f442a2 with identifier: KS69%20YXO to the API
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS69%20YXO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.9L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3e7210f7-8600-5df0-9988-597281f442a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KS69 YXO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS69%20YXO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'E400 D',
'odometer': 113463,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E400 D 2.9 AMG LINE NIGHT ED.PREM+ 4M 9G Estate',
'transmission': 'manual',
'trim': 'AMG LINE NIGHT ED.PREM+ 4M 9G',
'vin': 'W1K2132232A763257',
'year': 2020}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YXO%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [bca.uk] INFO: Saving data for KS69%20YXO: {'auction_closing_time': 1774864800.0, 'created_time': 1773931139.772152, 'last_price_update_time': 1774695785.069502}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS69%2520YXO') HTTP/1.1" 204 0
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818574%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818574 not downloaded yet
2026-03-28 11:03:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc92d0>
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811924%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811924/600 saved to cache
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5402d0>
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931532%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931532/600 saved to cache
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931567>
2026-03-28 11:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818536/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818536>
2026-03-28 11:03:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR10%20UYM-GB>
2026-03-28 11:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:03:05 [bca.uk] INFO: Found listing with ID: PJ66%20LUT
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520LUT%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [bca.uk] INFO: Scrape type for PJ66%20LUT: 2
2026-03-28 11:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c0fb6a2f-87b5-500c-a447-1f8ea0d2225c with identifier: PJ66%20LUT
2026-03-28 11:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c0fb6a2f-87b5-500c-a447-1f8ea0d2225c with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c0fb6a2f-87b5-500c-a447-1f8ea0d2225c with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c0fb6a2f-87b5-500c-a447-1f8ea0d2225c, identifier: PJ66%20LUT
2026-03-28 11:03:05 [bca.uk] INFO: Found listing with ID: PY66%20KMK
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY66%2520KMK%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [bca.uk] INFO: Scrape type for PY66%20KMK: 2
2026-03-28 11:03:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b6a5ba4a-bd87-5703-b3fe-69de043045a2 with identifier: PY66%20KMK
2026-03-28 11:03:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b6a5ba4a-bd87-5703-b3fe-69de043045a2 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b6a5ba4a-bd87-5703-b3fe-69de043045a2 with scrape type 2
2026-03-28 11:03:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b6a5ba4a-bd87-5703-b3fe-69de043045a2, identifier: PY66%20KMK
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801892%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801892 not downloaded yet
2026-03-28 11:03:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c0fb6a2f-87b5-500c-a447-1f8ea0d2225c with identifier: PJ66%20LUT
2026-03-28 11:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c0fb6a2f-87b5-500c-a447-1f8ea0d2225c with identifier: PJ66%20LUT
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c0fb6a2f-87b5-500c-a447-1f8ea0d2225c with identifier: PJ66%20LUT to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ66%20LUT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c0fb6a2f-87b5-500c-a447-1f8ea0d2225c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ66 LUT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ66%20LUT&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 64770,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 TEKNA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA XTRONIC',
'vin': 'SJNFBAF15U7230450',
'year': 2016}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520LUT%27 HTTP/1.1" 200 None
2026-03-28 11:03:05 [bca.uk] INFO: Saving data for PJ66%20LUT: {'auction_closing_time': 1774864800.0, 'created_time': 1773960414.251093, 'last_price_update_time': 1774695785.79499}
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ66%2520LUT') HTTP/1.1" 204 0
2026-03-28 11:03:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b6a5ba4a-bd87-5703-b3fe-69de043045a2 with identifier: PY66%20KMK
2026-03-28 11:03:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b6a5ba4a-bd87-5703-b3fe-69de043045a2 with identifier: PY66%20KMK
2026-03-28 11:03:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b6a5ba4a-bd87-5703-b3fe-69de043045a2 with identifier: PY66%20KMK to the API
2026-03-28 11:03:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 92,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY66%20KMK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': 'b6a5ba4a-bd87-5703-b3fe-69de043045a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PY66 KMK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY66%20KMK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'HYUNDAI',
'model': 'IONIQ HYBRID',
'odometer': 71034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'HYUNDAI IONIQ HYBRID 1.6 GDI 105 PREMIUM SE DCT Hatchback',
'transmission': 'automatic',
'trim': 'GDI 105 PREMIUM SE DCT',
'vin': 'KMHC851CVHU017927',
'year': 2017}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY66%2520KMK%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [bca.uk] INFO: Saving data for PY66%20KMK: {'auction_closing_time': 1774864800.0, 'created_time': 1774591864.398998, 'last_price_update_time': 1774695786.172508}
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY66%2520KMK') HTTP/1.1" 204 0
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818583%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818583 not downloaded yet
2026-03-28 11:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:06 [bca.uk] INFO: Found listing with ID: LFZ%202518
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LFZ%25202518%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [bca.uk] INFO: Scrape type for LFZ%202518: 0
2026-03-28 11:03:06 [bca.uk] INFO: Found listing with ID: SA10%20DVK
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA10%2520DVK%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [bca.uk] INFO: Scrape type for SA10%20DVK: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ebc744f-70ee-5a5a-a394-bd13a8b046a7 with identifier: SA10%20DVK
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ebc744f-70ee-5a5a-a394-bd13a8b046a7 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ebc744f-70ee-5a5a-a394-bd13a8b046a7 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ebc744f-70ee-5a5a-a394-bd13a8b046a7, identifier: SA10%20DVK
2026-03-28 11:03:06 [bca.uk] INFO: Found listing with ID: WV20%20WDZ
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520WDZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [bca.uk] INFO: Scrape type for WV20%20WDZ: 2
2026-03-28 11:03:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5a2c35b2-c252-58c1-a365-922ec09b82a6 with identifier: WV20%20WDZ
2026-03-28 11:03:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5a2c35b2-c252-58c1-a365-922ec09b82a6 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5a2c35b2-c252-58c1-a365-922ec09b82a6 with scrape type 2
2026-03-28 11:03:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a2c35b2-c252-58c1-a365-922ec09b82a6, identifier: WV20%20WDZ
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801901%27 HTTP/1.1" 200 None
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801901 not downloaded yet
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ba910>
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740356%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740356/600 saved to cache
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42f8d0>
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811948%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811948/600 saved to cache
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae882350>
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811923%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811923/600 saved to cache
2026-03-28 11:03:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818555>
2026-03-28 11:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK18%20JKO-GB>
2026-03-28 11:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818550>
2026-03-28 11:03:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ10%20LNA-GB>
2026-03-28 11:03:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ebc744f-70ee-5a5a-a394-bd13a8b046a7 with identifier: SA10%20DVK
2026-03-28 11:03:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ebc744f-70ee-5a5a-a394-bd13a8b046a7 with identifier: SA10%20DVK
2026-03-28 11:03:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ebc744f-70ee-5a5a-a394-bd13a8b046a7 with identifier: SA10%20DVK to the API
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SA10%20DVK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9ebc744f-70ee-5a5a-a394-bd13a8b046a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SA10 DVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SA10%20DVK&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 64370,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC',
'vin': 'WF0PXXWPDPAY22657',
'year': 2010}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA10%2520DVK%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [bca.uk] INFO: Saving data for SA10%20DVK: {'auction_closing_time': 1774864800.0, 'created_time': 1774591710.570668, 'last_price_update_time': 1774695787.075622}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SA10%2520DVK') HTTP/1.1" 204 0
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a2c35b2-c252-58c1-a365-922ec09b82a6 with identifier: WV20%20WDZ
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Electric HTTP/1.1" 200 None
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a2c35b2-c252-58c1-a365-922ec09b82a6 with identifier: WV20%20WDZ
2026-03-28 11:03:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a2c35b2-c252-58c1-a365-922ec09b82a6 with identifier: WV20%20WDZ to the API
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV20%20WDZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '5a2c35b2-c252-58c1-a365-922ec09b82a6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV20 WDZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV20%20WDZ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'RENAULT',
'model': 'ZOE',
'odometer': 103294,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'RENAULT ZOE 50KWH 110 I ICONIC (22KW) Hatchback',
'transmission': 'automatic',
'trim': '50KWH 110 I ICONIC (22KW)',
'vin': 'VF1AG000365110891',
'year': 2020}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV20%2520WDZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [bca.uk] INFO: Saving data for WV20%20WDZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773929572.205989, 'last_price_update_time': 1774695787.573464}
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV20%2520WDZ') HTTP/1.1" 204 0
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818591%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818591 not downloaded yet
2026-03-28 11:03:07 [bca.uk] INFO: Found listing with ID: A5%20VHE
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A5%2520VHE%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [bca.uk] INFO: Scrape type for A5%20VHE: 0
2026-03-28 11:03:07 [bca.uk] INFO: Found listing with ID: VK14%20NPY
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520NPY%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [bca.uk] INFO: Scrape type for VK14%20NPY: 2
2026-03-28 11:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bb13452-f04d-5958-9f4b-62f6d01a26ce with identifier: VK14%20NPY
2026-03-28 11:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bb13452-f04d-5958-9f4b-62f6d01a26ce with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bb13452-f04d-5958-9f4b-62f6d01a26ce with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3bb13452-f04d-5958-9f4b-62f6d01a26ce, identifier: VK14%20NPY
2026-03-28 11:03:07 [bca.uk] INFO: Found listing with ID: AGZ%204435
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AGZ%25204435%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [bca.uk] INFO: Scrape type for AGZ%204435: 2
2026-03-28 11:03:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7971ce60-a294-52be-83f9-d9feb16b52c1 with identifier: AGZ%204435
2026-03-28 11:03:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7971ce60-a294-52be-83f9-d9feb16b52c1 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7971ce60-a294-52be-83f9-d9feb16b52c1 with scrape type 2
2026-03-28 11:03:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7971ce60-a294-52be-83f9-d9feb16b52c1, identifier: AGZ%204435
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801913%27 HTTP/1.1" 200 None
2026-03-28 11:03:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801913 not downloaded yet
2026-03-28 11:03:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3bb13452-f04d-5958-9f4b-62f6d01a26ce with identifier: VK14%20NPY
2026-03-28 11:03:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3bb13452-f04d-5958-9f4b-62f6d01a26ce with identifier: VK14%20NPY
2026-03-28 11:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3bb13452-f04d-5958-9f4b-62f6d01a26ce with identifier: VK14%20NPY to the API
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK14%20NPY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3bb13452-f04d-5958-9f4b-62f6d01a26ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK14 NPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK14%20NPY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 88467,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 115 ZETEC S Hatchback',
'transmission': 'manual',
'trim': 'TDCI 115 ZETEC S',
'vin': 'WF0KXXGCBKEL62606',
'year': 2014}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520NPY%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [bca.uk] INFO: Saving data for VK14%20NPY: {'auction_closing_time': 1774778400.0, 'created_time': 1774476484.679794, 'last_price_update_time': 1774695788.247681}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK14%2520NPY') HTTP/1.1" 204 0
2026-03-28 11:03:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7971ce60-a294-52be-83f9-d9feb16b52c1 with identifier: AGZ%204435
2026-03-28 11:03:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7971ce60-a294-52be-83f9-d9feb16b52c1 with identifier: AGZ%204435
2026-03-28 11:03:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7971ce60-a294-52be-83f9-d9feb16b52c1 with identifier: AGZ%204435 to the API
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AGZ%204435-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7971ce60-a294-52be-83f9-d9feb16b52c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AGZ 4435',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AGZ%204435&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 82444,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC',
'vin': 'SALVA2AN8GH112333',
'year': 2016}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AGZ%25204435%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [bca.uk] INFO: Saving data for AGZ%204435: {'auction_closing_time': 1774864800.0, 'created_time': 1774048440.968862, 'last_price_update_time': 1774695788.685778}
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AGZ%25204435') HTTP/1.1" 204 0
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc93650>
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931544%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931544/600 saved to cache
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff3ee90>
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811953%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811953/600 saved to cache
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e55e010>
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_expert_report_file_5fc7791c-1df9-4f9b-9bcb-e2d134ba6ff6.pdf HTTP/1.1" 201 0
2026-03-28 11:03:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1827e19-d691-5b45-bd7b-2374a12925ba, skipping ID generation
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT12OGV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT12OGV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe46350>
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818517%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818517/600 saved to cache
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818536/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801886/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801886>
2026-03-28 11:03:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP65%20NNV-GB>
2026-03-28 11:03:08 [bca.uk] INFO: Found listing with ID: YE07%20CMY
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE07%2520CMY%27 HTTP/1.1" 200 None
2026-03-28 11:03:08 [bca.uk] INFO: Scrape type for YE07%20CMY: 2
2026-03-28 11:03:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8b534960-45e5-55b1-a45d-93555f69ee60 with identifier: YE07%20CMY
2026-03-28 11:03:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8b534960-45e5-55b1-a45d-93555f69ee60 with scrape type 2
2026-03-28 11:03:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8b534960-45e5-55b1-a45d-93555f69ee60 with scrape type 2
2026-03-28 11:03:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b534960-45e5-55b1-a45d-93555f69ee60, identifier: YE07%20CMY
2026-03-28 11:03:08 [bca.uk] INFO: Found listing with ID: FP67%20BNL
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520BNL%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [bca.uk] INFO: Scrape type for FP67%20BNL: 2
2026-03-28 11:03:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a1578651-9cbd-5596-bdae-765f699ee525 with identifier: FP67%20BNL
2026-03-28 11:03:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a1578651-9cbd-5596-bdae-765f699ee525 with scrape type 2
2026-03-28 11:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a1578651-9cbd-5596-bdae-765f699ee525 with scrape type 2
2026-03-28 11:03:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a1578651-9cbd-5596-bdae-765f699ee525, identifier: FP67%20BNL
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801918%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801918 not downloaded yet
2026-03-28 11:03:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b534960-45e5-55b1-a45d-93555f69ee60 with identifier: YE07%20CMY
2026-03-28 11:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b534960-45e5-55b1-a45d-93555f69ee60 with identifier: YE07%20CMY
2026-03-28 11:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b534960-45e5-55b1-a45d-93555f69ee60 with identifier: YE07%20CMY to the API
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YE07%20CMY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8b534960-45e5-55b1-a45d-93555f69ee60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YE07 CMY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YE07%20CMY&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 70397,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 LIFE Hatchback',
'transmission': 'manual',
'trim': '16V 115 LIFE',
'vin': 'W0L0AHL4878089339',
'year': 2007}
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE07%2520CMY%27 HTTP/1.1" 200 None
2026-03-28 11:03:09 [bca.uk] INFO: Saving data for YE07%20CMY: {'auction_closing_time': 1774778400.0, 'created_time': 1773908933.158052, 'last_price_update_time': 1774695789.710146}
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YE07%2520CMY') HTTP/1.1" 204 0
2026-03-28 11:03:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a1578651-9cbd-5596-bdae-765f699ee525 with identifier: FP67%20BNL
2026-03-28 11:03:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a1578651-9cbd-5596-bdae-765f699ee525 with identifier: FP67%20BNL
2026-03-28 11:03:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a1578651-9cbd-5596-bdae-765f699ee525 with identifier: FP67%20BNL to the API
2026-03-28 11:03:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP67%20BNL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a1578651-9cbd-5596-bdae-765f699ee525',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP67 BNL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP67%20BNL&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'BMW',
'model': '218I',
'odometer': 77749,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW 218I 1.5 T SE STEP Coupe',
'transmission': 'automatic',
'trim': 'T SE STEP',
'vin': 'WBA2H32030VB97409',
'year': 2017}
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520BNL%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [bca.uk] INFO: Saving data for FP67%20BNL: {'auction_closing_time': 1774864800.0, 'created_time': 1774591861.113288, 'last_price_update_time': 1774695790.170661}
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP67%2520BNL') HTTP/1.1" 204 0
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775462%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775462 not downloaded yet
2026-03-28 11:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801892>
2026-03-28 11:03:10 [bca.uk] INFO: Found listing with ID: YG61%20ZTR
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG61%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [bca.uk] INFO: Scrape type for YG61%20ZTR: 0
2026-03-28 11:03:10 [bca.uk] INFO: Found listing with ID: SB13%20MVJ
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [bca.uk] INFO: Scrape type for SB13%20MVJ: 0
2026-03-28 11:03:10 [bca.uk] INFO: Found listing with ID: SB66%20VUV
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520VUV%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [bca.uk] INFO: Scrape type for SB66%20VUV: 2
2026-03-28 11:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 52b7ed0a-3c45-5425-a191-3d86b6ba4c20 with identifier: SB66%20VUV
2026-03-28 11:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 52b7ed0a-3c45-5425-a191-3d86b6ba4c20 with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 52b7ed0a-3c45-5425-a191-3d86b6ba4c20 with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 52b7ed0a-3c45-5425-a191-3d86b6ba4c20, identifier: SB66%20VUV
2026-03-28 11:03:10 [bca.uk] INFO: Found listing with ID: GJ16%20DHC
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ16%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [bca.uk] INFO: Scrape type for GJ16%20DHC: 2
2026-03-28 11:03:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e88cb40e-95dd-5178-a38d-c3c21700737e with identifier: GJ16%20DHC
2026-03-28 11:03:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e88cb40e-95dd-5178-a38d-c3c21700737e with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e88cb40e-95dd-5178-a38d-c3c21700737e with scrape type 2
2026-03-28 11:03:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e88cb40e-95dd-5178-a38d-c3c21700737e, identifier: GJ16%20DHC
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801934%27 HTTP/1.1" 200 None
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801934 not downloaded yet
2026-03-28 11:03:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe46550>
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931550%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931550/600 saved to cache
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac417710>
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818544%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818544/600 saved to cache
2026-03-28 11:03:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818574>
2026-03-28 11:03:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:10 [scrapy.extensions.logstats] INFO: Crawled 72 pages (at 38 pages/min), scraped 138 items (at 78 items/min)
2026-03-28 11:03:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 191MiB
2026-03-28 11:03:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 52b7ed0a-3c45-5425-a191-3d86b6ba4c20 with identifier: SB66%20VUV
2026-03-28 11:03:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 52b7ed0a-3c45-5425-a191-3d86b6ba4c20 with identifier: SB66%20VUV
2026-03-28 11:03:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 52b7ed0a-3c45-5425-a191-3d86b6ba4c20 with identifier: SB66%20VUV to the API
2026-03-28 11:03:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SB66%20VUV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '52b7ed0a-3c45-5425-a191-3d86b6ba4c20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SB66 VUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SB66%20VUV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'ECOSPORT',
'odometer': 7033,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD ECOSPORT 1.0 E/B 125 ZETEC StationWagon',
'transmission': 'manual',
'trim': 'E/B 125 ZETEC',
'vin': 'WF0BXXMRKBGE45822',
'year': 2016}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520VUV%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [bca.uk] INFO: Saving data for SB66%20VUV: {'auction_closing_time': 1774778400.0, 'created_time': 1774362352.370967, 'last_price_update_time': 1774695791.172873}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SB66%2520VUV') HTTP/1.1" 204 0
2026-03-28 11:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e88cb40e-95dd-5178-a38d-c3c21700737e with identifier: GJ16%20DHC
2026-03-28 11:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e88cb40e-95dd-5178-a38d-c3c21700737e with identifier: GJ16%20DHC
2026-03-28 11:03:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e88cb40e-95dd-5178-a38d-c3c21700737e with identifier: GJ16%20DHC to the API
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ16%20DHC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e88cb40e-95dd-5178-a38d-c3c21700737e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ16 DHC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ16%20DHC&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'SHARAN',
'odometer': 101719,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN SHARAN 2.0 TDI 184 BMT SE DSG MPV',
'transmission': 'automatic',
'trim': 'TDI 184 BMT SE DSG',
'vin': 'WVWZZZ7NZGV229979',
'year': 2016}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ16%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [bca.uk] INFO: Saving data for GJ16%20DHC: {'auction_closing_time': 1774864800.0, 'created_time': 1774048385.849102, 'last_price_update_time': 1774695791.597909}
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ16%2520DHC') HTTP/1.1" 204 0
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775484%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775484 not downloaded yet
2026-03-28 11:03:11 [bca.uk] INFO: Found listing with ID: SC16%20CWE
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520CWE%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [bca.uk] INFO: Scrape type for SC16%20CWE: 2
2026-03-28 11:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 85885ba4-a7e3-55d5-a29f-fe42712f53b5 with identifier: SC16%20CWE
2026-03-28 11:03:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 85885ba4-a7e3-55d5-a29f-fe42712f53b5 with scrape type 2
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 85885ba4-a7e3-55d5-a29f-fe42712f53b5 with scrape type 2
2026-03-28 11:03:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 85885ba4-a7e3-55d5-a29f-fe42712f53b5, identifier: SC16%20CWE
2026-03-28 11:03:11 [bca.uk] INFO: Found listing with ID: KP15%20OKE
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP15%2520OKE%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [bca.uk] INFO: Scrape type for KP15%20OKE: 1
2026-03-28 11:03:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f with identifier: KP15%20OKE
2026-03-28 11:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801966%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801966 not downloaded yet
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1ab50>
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_expert_report_file_7d6f78aa-8fde-49b8-aaeb-c60f2e25a9ba.pdf HTTP/1.1" 201 0
2026-03-28 11:03:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af8b5473-208a-5762-a7c8-46860203893d, skipping ID generation
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLX64OPJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX64OPJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9f2750>
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818536%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818536/600 saved to cache
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3ef010>
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931567%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931567/600 saved to cache
2026-03-28 11:03:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:03:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818583>
2026-03-28 11:03:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 85885ba4-a7e3-55d5-a29f-fe42712f53b5 with identifier: SC16%20CWE
2026-03-28 11:03:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 85885ba4-a7e3-55d5-a29f-fe42712f53b5 with identifier: SC16%20CWE
2026-03-28 11:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 85885ba4-a7e3-55d5-a29f-fe42712f53b5 with identifier: SC16%20CWE to the API
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC16%20CWE-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '85885ba4-a7e3-55d5-a29f-fe42712f53b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC16 CWE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC16%20CWE&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 69369,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 16V DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': '16V DYNAMIQUE',
'vin': 'VF15RSN0A55277673',
'year': 2016}
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520CWE%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [bca.uk] INFO: Saving data for SC16%20CWE: {'auction_closing_time': 1774778400.0, 'created_time': 1774476500.348925, 'last_price_update_time': 1774695792.389299}
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC16%2520CWE') HTTP/1.1" 204 0
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775518%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775518 not downloaded yet
2026-03-28 11:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801913>
2026-03-28 11:03:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818591/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818591>
2026-03-28 11:03:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801886/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:03:12 [bca.uk] INFO: Found listing with ID: SC53%20TDX
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC53%2520TDX%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [bca.uk] INFO: Scrape type for SC53%20TDX: 2
2026-03-28 11:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d83c817-62ba-5139-be0f-7ee1fd336222 with identifier: SC53%20TDX
2026-03-28 11:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5d83c817-62ba-5139-be0f-7ee1fd336222 with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5d83c817-62ba-5139-be0f-7ee1fd336222 with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5d83c817-62ba-5139-be0f-7ee1fd336222, identifier: SC53%20TDX
2026-03-28 11:03:12 [bca.uk] INFO: Found listing with ID: EA14%20UBC
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520UBC%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [bca.uk] INFO: Scrape type for EA14%20UBC: 2
2026-03-28 11:03:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de with identifier: EA14%20UBC
2026-03-28 11:03:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de with scrape type 2
2026-03-28 11:03:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de, identifier: EA14%20UBC
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802008%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802008 not downloaded yet
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796530%27 HTTP/1.1" 200 None
2026-03-28 11:03:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796530 not downloaded yet
2026-03-28 11:03:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5d83c817-62ba-5139-be0f-7ee1fd336222 with identifier: SC53%20TDX
2026-03-28 11:03:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5d83c817-62ba-5139-be0f-7ee1fd336222 with identifier: SC53%20TDX
2026-03-28 11:03:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5d83c817-62ba-5139-be0f-7ee1fd336222 with identifier: SC53%20TDX to the API
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 172,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC53%20TDX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5d83c817-62ba-5139-be0f-7ee1fd336222',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC53 TDX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC53%20TDX&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 112077,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.6 VTEC SE Hatchback',
'transmission': 'automatic',
'trim': 'VTEC SE',
'vin': 'SHHEU88404U303719',
'year': 2004}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC53%2520TDX%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [bca.uk] INFO: Saving data for SC53%20TDX: {'auction_closing_time': 1774778400.0, 'created_time': 1773909053.341361, 'last_price_update_time': 1774695793.074969}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC53%2520TDX') HTTP/1.1" 204 0
2026-03-28 11:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de with identifier: EA14%20UBC
2026-03-28 11:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de with identifier: EA14%20UBC
2026-03-28 11:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8068c2b1-9fb3-51d2-9acf-1a4ee259b1de with identifier: EA14%20UBC to the API
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA14%20UBC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '8068c2b1-9fb3-51d2-9acf-1a4ee259b1de',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA14 UBC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA14%20UBC&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'TOYOTA',
'model': 'PRIUS',
'odometer': 271121,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'TOYOTA PRIUS 1.8 VVTI T3 HYBRID Hatchback',
'transmission': 'automatic',
'trim': 'VVTI T3 HYBRID',
'vin': 'JTDKN36U101781756',
'year': 2014}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA14%2520UBC%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [bca.uk] INFO: Saving data for EA14%20UBC: {'auction_closing_time': 1774778400.0, 'created_time': 1774564578.947273, 'last_price_update_time': 1774695793.422906}
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA14%2520UBC') HTTP/1.1" 204 0
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775537%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775537 not downloaded yet
2026-03-28 11:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe72ad0>
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_expert_report_file_96b2cabd-47e9-48f1-bc1a-4e4e1caf29ff.pdf HTTP/1.1" 201 0
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb, skipping ID generation
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD56WYJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD56WYJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1e290>
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_expert_report_file_01ee8c97-c390-419b-ae1d-8efc7d8045f5.pdf HTTP/1.1" 201 0
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c, skipping ID generation
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLR10UYM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR10UYM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07090>
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818550%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818550/600 saved to cache
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:03:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801901>
2026-03-28 11:03:13 [bca.uk] INFO: Found listing with ID: SD12%20KXT
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD12%2520KXT%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [bca.uk] INFO: Scrape type for SD12%20KXT: 0
2026-03-28 11:03:13 [bca.uk] INFO: Found listing with ID: SH11%20YDW
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520YDW%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [bca.uk] INFO: Scrape type for SH11%20YDW: 2
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3857effe-eda0-559f-acda-abdf4de02a7c with identifier: SH11%20YDW
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3857effe-eda0-559f-acda-abdf4de02a7c with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3857effe-eda0-559f-acda-abdf4de02a7c with scrape type 2
2026-03-28 11:03:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3857effe-eda0-559f-acda-abdf4de02a7c, identifier: SH11%20YDW
2026-03-28 11:03:13 [bca.uk] INFO: Found listing with ID: EY66%20UZM
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520UZM%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [bca.uk] INFO: Scrape type for EY66%20UZM: 1
2026-03-28 11:03:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53 with identifier: EY66%20UZM
2026-03-28 11:03:13 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802041%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802041 not downloaded yet
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796533%27 HTTP/1.1" 200 None
2026-03-28 11:03:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796533 not downloaded yet
2026-03-28 11:03:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3857effe-eda0-559f-acda-abdf4de02a7c with identifier: SH11%20YDW
2026-03-28 11:03:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3857effe-eda0-559f-acda-abdf4de02a7c with identifier: SH11%20YDW
2026-03-28 11:03:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3857effe-eda0-559f-acda-abdf4de02a7c with identifier: SH11%20YDW to the API
2026-03-28 11:03:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH11%20YDW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3857effe-eda0-559f-acda-abdf4de02a7c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH11 YDW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH11%20YDW&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'FORD',
'model': 'KA',
'odometer': 57834,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 EDGE S/S Hatchback',
'transmission': 'manual',
'trim': 'EDGE S/S',
'vin': 'WF0UXXLTRUBE84705',
'year': 2011}
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH11%2520YDW%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Saving data for SH11%20YDW: {'auction_closing_time': 1774778400.0, 'created_time': 1774303505.635854, 'last_price_update_time': 1774695794.201701}
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH11%2520YDW') HTTP/1.1" 204 0
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775553%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775553 not downloaded yet
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801919%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801919 not downloaded yet
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796517%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796517 not downloaded yet
2026-03-28 11:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801918>
2026-03-28 11:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775462/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775462>
2026-03-28 11:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT12OGV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:14 [bca.uk] INFO: Found listing with ID: SH60%20LDZ
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH60%2520LDZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Scrape type for SH60%20LDZ: 0
2026-03-28 11:03:14 [bca.uk] INFO: Found listing with ID: SK63%20FLJ
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK63%2520FLJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Scrape type for SK63%20FLJ: 0
2026-03-28 11:03:14 [bca.uk] INFO: Found listing with ID: SL13%20PTX
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL13%2520PTX%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Scrape type for SL13%20PTX: 0
2026-03-28 11:03:14 [bca.uk] INFO: Found listing with ID: SM13%20DLO
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520DLO%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Scrape type for SM13%20DLO: 1
2026-03-28 11:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1ca16b7-d422-595f-b73a-e56ec1893e19 with identifier: SM13%20DLO
2026-03-28 11:03:14 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:03:14 [bca.uk] INFO: Found listing with ID: LV59%20HND
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520HND%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Scrape type for LV59%20HND: 0
2026-03-28 11:03:14 [bca.uk] INFO: Found listing with ID: MF09%20TBZ
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF09%2520TBZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [bca.uk] INFO: Scrape type for MF09%20TBZ: 2
2026-03-28 11:03:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b8652f0-699b-5269-b486-0e91d5a03afb with identifier: MF09%20TBZ
2026-03-28 11:03:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0b8652f0-699b-5269-b486-0e91d5a03afb with scrape type 2
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0b8652f0-699b-5269-b486-0e91d5a03afb with scrape type 2
2026-03-28 11:03:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0b8652f0-699b-5269-b486-0e91d5a03afb, identifier: MF09%20TBZ
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796535%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796535 not downloaded yet
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24eed0>
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818555%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818555/600 saved to cache
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb493d0>
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_expert_report_file_38e859e6-fc99-4793-8fd7-4c32e957672f.pdf HTTP/1.1" 201 0
2026-03-28 11:03:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f73c621-a26f-5e74-976e-c93fdd575bad, skipping ID generation
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSK18JKO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SK18JKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb72950>
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801886%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801886/600 saved to cache
2026-03-28 11:03:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:14 [bca.uk] INFO: Total items found: 100
2026-03-28 11:03:14 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded
2026-03-28 11:03:14 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:03:14 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:03:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818563>
2026-03-28 11:03:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0b8652f0-699b-5269-b486-0e91d5a03afb with identifier: MF09%20TBZ
2026-03-28 11:03:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0b8652f0-699b-5269-b486-0e91d5a03afb with identifier: MF09%20TBZ
2026-03-28 11:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0b8652f0-699b-5269-b486-0e91d5a03afb with identifier: MF09%20TBZ to the API
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF09%20TBZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0b8652f0-699b-5269-b486-0e91d5a03afb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF09 TBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF09%20TBZ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 121671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI 122 S DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 122 S DSG',
'vin': 'WVWZZZ1KZ9W481134',
'year': 2009}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF09%2520TBZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Saving data for MF09%20TBZ: {'auction_closing_time': 1774778400.0, 'created_time': 1774564578.54422, 'last_price_update_time': 1774695795.268542}
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF09%2520TBZ') HTTP/1.1" 204 0
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775582%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775582 not downloaded yet
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801930%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801930 not downloaded yet
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796520%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796520 not downloaded yet
2026-03-28 11:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818583/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: SM58%20EZH
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM58%2520EZH%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for SM58%20EZH: 0
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: SP63%20WOR
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP63%2520WOR%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for SP63%20WOR: 0
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: EJ14%20VWN
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520VWN%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for EJ14%20VWN: 0
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: EO60%20VMK
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520VMK%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for EO60%20VMK: 0
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: FY12%20XKT
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY12%2520XKT%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for FY12%20XKT: 0
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: GJ68%20ELH
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520ELH%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for GJ68%20ELH: 2
2026-03-28 11:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa63104e-eadf-51a9-b95f-91b687dcef0a with identifier: GJ68%20ELH
2026-03-28 11:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa63104e-eadf-51a9-b95f-91b687dcef0a with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa63104e-eadf-51a9-b95f-91b687dcef0a with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa63104e-eadf-51a9-b95f-91b687dcef0a, identifier: GJ68%20ELH
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: WF59%20WBN
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF59%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for WF59%20WBN: 2
2026-03-28 11:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44c45f5d-0e2b-5d96-ae95-a74841c036a3 with identifier: WF59%20WBN
2026-03-28 11:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44c45f5d-0e2b-5d96-ae95-a74841c036a3 with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44c45f5d-0e2b-5d96-ae95-a74841c036a3 with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44c45f5d-0e2b-5d96-ae95-a74841c036a3, identifier: WF59%20WBN
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796537%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796537 not downloaded yet
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793607%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793607 not downloaded yet
2026-03-28 11:03:15 [bca.uk] INFO: Found listing with ID: DG11%20EGJ
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG11%2520EGJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:15 [bca.uk] INFO: Scrape type for DG11%20EGJ: 2
2026-03-28 11:03:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ
2026-03-28 11:03:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b8647183-3677-55e2-bb9a-1422cfd4cb83 with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b8647183-3677-55e2-bb9a-1422cfd4cb83 with scrape type 2
2026-03-28 11:03:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b8647183-3677-55e2-bb9a-1422cfd4cb83, identifier: DG11%20EGJ
2026-03-28 11:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775484>
2026-03-28 11:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775518/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775518>
2026-03-28 11:03:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LX64OPJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:03:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa63104e-eadf-51a9-b95f-91b687dcef0a with identifier: GJ68%20ELH
2026-03-28 11:03:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa63104e-eadf-51a9-b95f-91b687dcef0a with identifier: GJ68%20ELH
2026-03-28 11:03:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa63104e-eadf-51a9-b95f-91b687dcef0a with identifier: GJ68%20ELH to the API
2026-03-28 11:03:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ68%20ELH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aa63104e-eadf-51a9-b95f-91b687dcef0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ68 ELH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ68%20ELH&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'AUDI',
'model': 'A4',
'odometer': 165744,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 TDI ULTRA 150 SPORT S-T Saloon',
'transmission': 'automatic',
'trim': 'TDI ULTRA 150 SPORT S-T',
'vin': 'WAUZZZF4XJA189776',
'year': 2018}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520ELH%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [bca.uk] INFO: Saving data for GJ68%20ELH: {'auction_closing_time': 1774778400.0, 'created_time': 1774479747.840967, 'last_price_update_time': 1774695796.259703}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ68%2520ELH') HTTP/1.1" 204 0
2026-03-28 11:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44c45f5d-0e2b-5d96-ae95-a74841c036a3 with identifier: WF59%20WBN
2026-03-28 11:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44c45f5d-0e2b-5d96-ae95-a74841c036a3 with identifier: WF59%20WBN
2026-03-28 11:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44c45f5d-0e2b-5d96-ae95-a74841c036a3 with identifier: WF59%20WBN to the API
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF59%20WBN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '44c45f5d-0e2b-5d96-ae95-a74841c036a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF59 WBN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF59%20WBN&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'AUDI',
'model': 'A5 CABRIOLET',
'odometer': 105107,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'AUDI A5 CABRIOLET 2.0 TFSI S LINE S/S Convertible',
'transmission': 'manual',
'trim': 'TFSI S LINE S/S',
'vin': 'WAUZZZ8F5AN002631',
'year': 2009}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF59%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [bca.uk] INFO: Saving data for WF59%20WBN: {'auction_closing_time': 1774778400.0, 'created_time': 1774564579.732641, 'last_price_update_time': 1774695796.800864}
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF59%2520WBN') HTTP/1.1" 204 0
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775607%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775607 not downloaded yet
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801939%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801939 not downloaded yet
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796562%27 HTTP/1.1" 200 None
2026-03-28 11:03:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796562 not downloaded yet
2026-03-28 11:03:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ
2026-03-28 11:03:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ
2026-03-28 11:03:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b8647183-3677-55e2-bb9a-1422cfd4cb83 with identifier: DG11%20EGJ to the API
2026-03-28 11:03:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG11%20EGJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b8647183-3677-55e2-bb9a-1422cfd4cb83',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG11 EGJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG11%20EGJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'SCIROCCO',
'odometer': 146504,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN SCIROCCO 2.0 TDI 170 GT DSG Coupe',
'transmission': 'automatic',
'trim': 'TDI 170 GT DSG',
'vin': 'WVWZZZ13ZBV026719',
'year': 2011}
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG11%2520EGJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [bca.uk] INFO: Saving data for DG11%20EGJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774564567.217223, 'last_price_update_time': 1774695797.252655}
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG11%2520EGJ') HTTP/1.1" 204 0
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fff8b10>
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801892%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801892/600 saved to cache
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e61dc90>
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_expert_report_file_46e32bd4-45f3-43f2-ad41-ac3259cb791c.pdf HTTP/1.1" 201 0
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c46ed1ba-1db0-5976-a700-17645579f4fb, skipping ID generation
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNJ10LNA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ10LNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2cf50>
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_expert_report_file_a738562c-6f59-4482-9e58-1d13524aa677.pdf HTTP/1.1" 201 0
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baefc678-d212-5082-a8e0-52e336dc5403, skipping ID generation
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKP65NNV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP65NNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796530/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796530>
2026-03-28 11:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:03:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818591/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:17 [bca.uk] INFO: Found listing with ID: GK60%20AVB
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520AVB%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [bca.uk] INFO: Scrape type for GK60%20AVB: 2
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ddde701d-a6cd-578e-b9bf-bd422012e5d6 with identifier: GK60%20AVB
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ddde701d-a6cd-578e-b9bf-bd422012e5d6 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ddde701d-a6cd-578e-b9bf-bd422012e5d6 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ddde701d-a6cd-578e-b9bf-bd422012e5d6, identifier: GK60%20AVB
2026-03-28 11:03:17 [bca.uk] INFO: Found listing with ID: YK18%20EUH
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK18%2520EUH%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [bca.uk] INFO: Scrape type for YK18%20EUH: 0
2026-03-28 11:03:17 [bca.uk] INFO: Found listing with ID: BK68%20ECE
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520ECE%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [bca.uk] INFO: Scrape type for BK68%20ECE: 2
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1 with identifier: BK68%20ECE
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1 with scrape type 2
2026-03-28 11:03:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1, identifier: BK68%20ECE
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796551%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796551 not downloaded yet
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793615%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793615 not downloaded yet
2026-03-28 11:03:17 [bca.uk] INFO: Found listing with ID: KM18%20ZYB
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520ZYB%27 HTTP/1.1" 200 None
2026-03-28 11:03:17 [bca.uk] INFO: Scrape type for KM18%20ZYB: 1
2026-03-28 11:03:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3355af6-f641-5eb5-8dc1-8e17df374efc with identifier: KM18%20ZYB
2026-03-28 11:03:17 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:03:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ddde701d-a6cd-578e-b9bf-bd422012e5d6 with identifier: GK60%20AVB
2026-03-28 11:03:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ddde701d-a6cd-578e-b9bf-bd422012e5d6 with identifier: GK60%20AVB
2026-03-28 11:03:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ddde701d-a6cd-578e-b9bf-bd422012e5d6 with identifier: GK60%20AVB to the API
2026-03-28 11:03:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK60%20AVB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ddde701d-a6cd-578e-b9bf-bd422012e5d6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK60 AVB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK60%20AVB&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 38590,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TWIST Hatchback',
'transmission': 'manual',
'trim': 'TWIST',
'vin': 'WVWZZZ1KZBW127647',
'year': 2010}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520AVB%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Saving data for GK60%20AVB: {'auction_closing_time': 1774778400.0, 'created_time': 1774563771.990136, 'last_price_update_time': 1774695798.24573}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK60%2520AVB') HTTP/1.1" 204 0
2026-03-28 11:03:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1 with identifier: BK68%20ECE
2026-03-28 11:03:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1 with identifier: BK68%20ECE
2026-03-28 11:03:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1 with identifier: BK68%20ECE to the API
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK68%20ECE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4e1a46d5-fd2e-53bc-b40e-0567b1e1d2c1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK68 ECE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK68%20ECE&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 56907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.2 DIG-T N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T N-CONNECTA',
'vin': 'SJNFEAJ11U2332722',
'year': 2018}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK68%2520ECE%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Saving data for BK68%20ECE: {'auction_closing_time': 1774864800.0, 'created_time': 1773960347.79281, 'last_price_update_time': 1774695798.631827}
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK68%2520ECE') HTTP/1.1" 204 0
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775643%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775643 not downloaded yet
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801957%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801957 not downloaded yet
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796824%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796824 not downloaded yet
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786763%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786763 not downloaded yet
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293565%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293565 not downloaded yet
2026-03-28 11:03:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802008>
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: PE11%20YJD
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE11%2520YJD%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for PE11%20YJD: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: R12%20TRA
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R12%2520TRA%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for R12%20TRA: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: YK22%20RXB
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520RXB%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for YK22%20RXB: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: SG60%20RXA
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG60%2520RXA%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for SG60%20RXA: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: N88%20SFD
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N88%2520SFD%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for N88%20SFD: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: WU57%20NZB
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU57%2520NZB%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for WU57%20NZB: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: GL58%20GUC
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL58%2520GUC%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for GL58%20GUC: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: GF11%20ZWK
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF11%2520ZWK%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for GF11%20ZWK: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: GU12%20UYL
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU12%2520UYL%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for GU12%20UYL: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: HV57%20ETA
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV57%2520ETA%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for HV57%20ETA: 0
2026-03-28 11:03:18 [bca.uk] INFO: Found listing with ID: LB57%20JJE
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB57%2520JJE%27 HTTP/1.1" 200 None
2026-03-28 11:03:18 [bca.uk] INFO: Scrape type for LB57%20JJE: 2
2026-03-28 11:03:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3c0129d-3bb2-5250-a107-8878f605dff1 with identifier: LB57%20JJE
2026-03-28 11:03:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3c0129d-3bb2-5250-a107-8878f605dff1 with scrape type 2
2026-03-28 11:03:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3c0129d-3bb2-5250-a107-8878f605dff1 with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d3c0129d-3bb2-5250-a107-8878f605dff1, identifier: LB57%20JJE
2026-03-28 11:03:19 [bca.uk] INFO: Found listing with ID: BP19%20TWZ
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP19%2520TWZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [bca.uk] INFO: Scrape type for BP19%20TWZ: 0
2026-03-28 11:03:19 [bca.uk] INFO: Found listing with ID: SK72%20YTM
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK72%2520YTM%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [bca.uk] INFO: Scrape type for SK72%20YTM: 0
2026-03-28 11:03:19 [bca.uk] INFO: Found listing with ID: EX13%20UKP
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UKP%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [bca.uk] INFO: Scrape type for EX13%20UKP: 1
2026-03-28 11:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44 with identifier: EX13%20UKP
2026-03-28 11:03:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796573%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796573 not downloaded yet
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793626%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793626 not downloaded yet
2026-03-28 11:03:19 [bca.uk] INFO: Found listing with ID: LA10%20WZY
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA10%2520WZY%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [bca.uk] INFO: Scrape type for LA10%20WZY: 2
2026-03-28 11:03:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aa4f76cb-5835-5acd-926c-c4926ebb239b with identifier: LA10%20WZY
2026-03-28 11:03:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item aa4f76cb-5835-5acd-926c-c4926ebb239b with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item aa4f76cb-5835-5acd-926c-c4926ebb239b with scrape type 2
2026-03-28 11:03:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aa4f76cb-5835-5acd-926c-c4926ebb239b, identifier: LA10%20WZY
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fde8d50>
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818574%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818574/600 saved to cache
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e423050>
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818583%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818583/600 saved to cache
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3eeb10>
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801913%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801913/600 saved to cache
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d3c0129d-3bb2-5250-a107-8878f605dff1 with identifier: LB57%20JJE
2026-03-28 11:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d3c0129d-3bb2-5250-a107-8878f605dff1 with identifier: LB57%20JJE
2026-03-28 11:03:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d3c0129d-3bb2-5250-a107-8878f605dff1 with identifier: LB57%20JJE to the API
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=4&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB57%20JJE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd3c0129d-3bb2-5250-a107-8878f605dff1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB57 JJE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB57%20JJE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'KIA',
'model': 'CEED',
'odometer': 68275,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 LS Hatchback',
'transmission': 'manual',
'trim': 'LS',
'vin': 'U5YFF24227L028833',
'year': 2007}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB57%2520JJE%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [bca.uk] INFO: Saving data for LB57%20JJE: {'auction_closing_time': 1774778400.0, 'created_time': 1774564556.541962, 'last_price_update_time': 1774695799.757133}
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB57%2520JJE') HTTP/1.1" 204 0
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775668%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775668 not downloaded yet
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698801975%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801975 not downloaded yet
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796847%27 HTTP/1.1" 200 None
2026-03-28 11:03:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796847 not downloaded yet
2026-03-28 11:03:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aa4f76cb-5835-5acd-926c-c4926ebb239b with identifier: LA10%20WZY
2026-03-28 11:03:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aa4f76cb-5835-5acd-926c-c4926ebb239b with identifier: LA10%20WZY
2026-03-28 11:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aa4f76cb-5835-5acd-926c-c4926ebb239b with identifier: LA10%20WZY to the API
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 396,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LA10%20WZY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '6.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'aa4f76cb-5835-5acd-926c-c4926ebb239b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LA10 WZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LA10%20WZY&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BENTLEY',
'model': 'FLYING SPUR',
'odometer': 49200,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BENTLEY FLYING SPUR 6.0 W12 SPEED Saloon',
'transmission': 'manual',
'trim': 'W12 SPEED',
'vin': 'SCBBJ53W7BC067069',
'year': 2010}
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA10%2520WZY%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [bca.uk] INFO: Saving data for LA10%20WZY: {'auction_closing_time': 1774778400.0, 'created_time': 1774048271.389999, 'last_price_update_time': 1774695800.274227}
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LA10%2520WZY') HTTP/1.1" 204 0
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786780%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786780 not downloaded yet
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293596%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293596 not downloaded yet
2026-03-28 11:03:20 [bca.uk] INFO: Found listing with ID: KY64%20TVO
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY64%2520TVO%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [bca.uk] INFO: Scrape type for KY64%20TVO: 2
2026-03-28 11:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 44b1f291-648f-535e-9f17-1ff7436d12c9 with identifier: KY64%20TVO
2026-03-28 11:03:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 44b1f291-648f-535e-9f17-1ff7436d12c9 with scrape type 2
2026-03-28 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 44b1f291-648f-535e-9f17-1ff7436d12c9 with scrape type 2
2026-03-28 11:03:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 44b1f291-648f-535e-9f17-1ff7436d12c9, identifier: KY64%20TVO
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796584%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796584 not downloaded yet
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793634%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793634 not downloaded yet
2026-03-28 11:03:20 [bca.uk] INFO: Found listing with ID: WF61%20VPM
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520VPM%27 HTTP/1.1" 200 None
2026-03-28 11:03:20 [bca.uk] INFO: Scrape type for WF61%20VPM: 1
2026-03-28 11:03:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 28ab50ea-4f5a-545f-b49b-8b86322ed399 with identifier: WF61%20VPM
2026-03-28 11:03:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 44b1f291-648f-535e-9f17-1ff7436d12c9 with identifier: KY64%20TVO
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=mauve%2Fpurple HTTP/1.1" 200 None
2026-03-28 11:03:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:03:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 44b1f291-648f-535e-9f17-1ff7436d12c9 with identifier: KY64%20TVO
2026-03-28 11:03:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 44b1f291-648f-535e-9f17-1ff7436d12c9 with identifier: KY64%20TVO to the API
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY64%20TVO-GB',
'category': 'Car',
'color': 'mauve',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '44b1f291-648f-535e-9f17-1ff7436d12c9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY64 TVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY64%20TVO&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'SKODA',
'model': 'SUPERB',
'odometer': 53419,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA SUPERB 2.0 TDI CR 170 SE 4X4 DSG Estate',
'transmission': 'automatic',
'trim': 'TDI CR 170 SE 4X4 DSG',
'vin': 'TMBMF73T6F9025696',
'year': 2015}
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY64%2520TVO%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [bca.uk] INFO: Saving data for KY64%20TVO: {'auction_closing_time': 1774778400.0, 'created_time': 1774564231.380286, 'last_price_update_time': 1774695801.144259}
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY64%2520TVO') HTTP/1.1" 204 0
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802011%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802011 not downloaded yet
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796868%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796868 not downloaded yet
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786790%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786790 not downloaded yet
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293600%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293600 not downloaded yet
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e29aa10>
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801901%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801901/600 saved to cache
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce11d0>
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818591%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818591/600 saved to cache
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:21 [bca.uk] INFO: Found listing with ID: SC66%20FDM
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC66%2520FDM%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [bca.uk] INFO: Scrape type for SC66%20FDM: 2
2026-03-28 11:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6d045ddd-ce6d-5a8d-8642-3cb6a622425f with identifier: SC66%20FDM
2026-03-28 11:03:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6d045ddd-ce6d-5a8d-8642-3cb6a622425f with scrape type 2
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6d045ddd-ce6d-5a8d-8642-3cb6a622425f with scrape type 2
2026-03-28 11:03:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6d045ddd-ce6d-5a8d-8642-3cb6a622425f, identifier: SC66%20FDM
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796593%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796593 not downloaded yet
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793639%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793639 not downloaded yet
2026-03-28 11:03:21 [bca.uk] INFO: Found listing with ID: WJ58%20ZNU
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520ZNU%27 HTTP/1.1" 200 None
2026-03-28 11:03:21 [bca.uk] INFO: Scrape type for WJ58%20ZNU: 1
2026-03-28 11:03:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe with identifier: WJ58%20ZNU
2026-03-28 11:03:21 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:03:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6d045ddd-ce6d-5a8d-8642-3cb6a622425f with identifier: SC66%20FDM
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=orange HTTP/1.1" 200 None
2026-03-28 11:03:21 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:03:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6d045ddd-ce6d-5a8d-8642-3cb6a622425f with identifier: SC66%20FDM
2026-03-28 11:03:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6d045ddd-ce6d-5a8d-8642-3cb6a622425f with identifier: SC66%20FDM to the API
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SC66%20FDM-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6d045ddd-ce6d-5a8d-8642-3cb6a622425f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SC66 FDM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SC66%20FDM&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'JEEP',
'model': 'RENEGADE',
'odometer': 33453,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'JEEP RENEGADE 2.0 M/JET 140 LONGITUDE 4WD Hatchback',
'transmission': 'manual',
'trim': 'M/JET 140 LONGITUDE 4WD',
'vin': '1C4BU0000GPD10409',
'year': 2016}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC66%2520FDM%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Saving data for SC66%20FDM: {'auction_closing_time': 1774778400.0, 'created_time': 1774476845.597542, 'last_price_update_time': 1774695802.014147}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SC66%2520FDM') HTTP/1.1" 204 0
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802044%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802044 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796888%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796888 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786805%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786805 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293602%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293602 not downloaded yet
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: SN63%20HJG
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520HJG%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for SN63%20HJG: 0
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: SV10%20UOD
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV10%2520UOD%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for SV10%20UOD: 0
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: YK68%20KNO
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK68%2520KNO%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for YK68%20KNO: 0
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: SD60%20AGX
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520AGX%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for SD60%20AGX: 1
2026-03-28 11:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 98ba0866-113f-5795-bc05-eca7493443d3 with identifier: SD60%20AGX
2026-03-28 11:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796603%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796603 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793656%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793656 not downloaded yet
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: DH66%20OBL
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH66%2520OBL%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for DH66%20OBL: 1
2026-03-28 11:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cb019db5-f305-538c-b142-6039ad8ff322 with identifier: DH66%20OBL
2026-03-28 11:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802076%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802076 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796913%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796913 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786820%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786820 not downloaded yet
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293604%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293604 not downloaded yet
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: FL15%20SDZ
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL15%2520SDZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for FL15%20SDZ: 0
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: KJ18%20TUV
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520TUV%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for KJ18%20TUV: 2
2026-03-28 11:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6 with identifier: KJ18%20TUV
2026-03-28 11:03:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6 with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6 with scrape type 2
2026-03-28 11:03:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6, identifier: KJ18%20TUV
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793670%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793670 not downloaded yet
2026-03-28 11:03:22 [bca.uk] INFO: Found listing with ID: KX64%20WYR
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX64%2520WYR%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Scrape type for KX64%20WYR: 1
2026-03-28 11:03:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f4eccf9d-8001-5d5e-9db1-5dec162636ac with identifier: KX64%20WYR
2026-03-28 11:03:22 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:03:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796530/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:03:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6 with identifier: KJ18%20TUV
2026-03-28 11:03:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6 with identifier: KJ18%20TUV
2026-03-28 11:03:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6 with identifier: KJ18%20TUV to the API
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ18%20TUV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'eacf9bd7-3bd9-5ba5-8cd1-d902d4cc3cd6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ18 TUV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ18%20TUV&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'SEAT',
'model': 'LEON ST',
'odometer': 116291,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT LEON ST 1.6 TDI 115 SE DYNAMIC TECH.DSG Estate',
'transmission': 'automatic',
'trim': 'TDI 115 SE DYNAMIC TECH.DSG',
'vin': 'VSSZZZ5FZJR172817',
'year': 2018}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520TUV%27 HTTP/1.1" 200 None
2026-03-28 11:03:22 [bca.uk] INFO: Saving data for KJ18%20TUV: {'auction_closing_time': 1774864800.0, 'created_time': 1774591865.801171, 'last_price_update_time': 1774695802.907214}
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ18%2520TUV') HTTP/1.1" 204 0
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802097%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802097 not downloaded yet
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796927%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796927 not downloaded yet
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786847%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786847 not downloaded yet
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293607%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293607 not downloaded yet
2026-03-28 11:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775462/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775518/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:03:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: RK19%20KCU
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK19%2520KCU%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for RK19%20KCU: 0
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: DU64%20UHM
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520UHM%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for DU64%20UHM: 0
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: SP07%20GLF
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP07%2520GLF%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for SP07%20GLF: 0
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: CN60%20JNJ
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN60%2520JNJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for CN60%20JNJ: 0
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: SJ12%20WND
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ12%2520WND%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for SJ12%20WND: 0
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: SK06%20YHE
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK06%2520YHE%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for SK06%20YHE: 2
2026-03-28 11:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31ff40ff-2330-55d8-9dfb-a58115e5e212 with identifier: SK06%20YHE
2026-03-28 11:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31ff40ff-2330-55d8-9dfb-a58115e5e212 with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31ff40ff-2330-55d8-9dfb-a58115e5e212 with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31ff40ff-2330-55d8-9dfb-a58115e5e212, identifier: SK06%20YHE
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793685%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793685 not downloaded yet
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: WG09%20CXU
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG09%2520CXU%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for WG09%20CXU: 1
2026-03-28 11:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8 with identifier: WG09%20CXU
2026-03-28 11:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31ff40ff-2330-55d8-9dfb-a58115e5e212 with identifier: SK06%20YHE
2026-03-28 11:03:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31ff40ff-2330-55d8-9dfb-a58115e5e212 with identifier: SK06%20YHE
2026-03-28 11:03:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31ff40ff-2330-55d8-9dfb-a58115e5e212 with identifier: SK06%20YHE to the API
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK06%20YHE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '31ff40ff-2330-55d8-9dfb-a58115e5e212',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK06 YHE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK06%20YHE&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'TOYOTA',
'model': 'COROLLA',
'odometer': 80411,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'TOYOTA COROLLA 1.6 VVTI COLOUR COLLECTION Hatchback',
'transmission': 'manual',
'trim': 'VVTI COLOUR COLLECTION',
'vin': 'SB1KZ20E50F030425',
'year': 2006}
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK06%2520YHE%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Saving data for SK06%20YHE: {'auction_closing_time': 1774778400.0, 'created_time': 1774479595.817143, 'last_price_update_time': 1774695803.793863}
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK06%2520YHE') HTTP/1.1" 204 0
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786870%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786870 not downloaded yet
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293610%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293610 not downloaded yet
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: SP10%20OWU
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP10%2520OWU%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for SP10%20OWU: 2
2026-03-28 11:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e7b47900-25a1-5a04-ade6-9e4cf9b88285 with identifier: SP10%20OWU
2026-03-28 11:03:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e7b47900-25a1-5a04-ade6-9e4cf9b88285 with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e7b47900-25a1-5a04-ade6-9e4cf9b88285 with scrape type 2
2026-03-28 11:03:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e7b47900-25a1-5a04-ade6-9e4cf9b88285, identifier: SP10%20OWU
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793693%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793693 not downloaded yet
2026-03-28 11:03:23 [bca.uk] INFO: Found listing with ID: BW15%20UPM
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520UPM%27 HTTP/1.1" 200 None
2026-03-28 11:03:23 [bca.uk] INFO: Scrape type for BW15%20UPM: 1
2026-03-28 11:03:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM
2026-03-28 11:03:23 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796868>
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796584>
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802011>
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793634/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793634>
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293600>
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF61%20VPM-GB>
2026-03-28 11:03:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:03:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786790/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786790>
2026-03-28 11:03:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e7b47900-25a1-5a04-ade6-9e4cf9b88285 with identifier: SP10%20OWU
2026-03-28 11:03:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e7b47900-25a1-5a04-ade6-9e4cf9b88285 with identifier: SP10%20OWU
2026-03-28 11:03:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e7b47900-25a1-5a04-ade6-9e4cf9b88285 with identifier: SP10%20OWU to the API
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP10%20OWU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e7b47900-25a1-5a04-ade6-9e4cf9b88285',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP10 OWU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP10%20OWU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MAZDA',
'model': '3',
'odometer': 43305,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MAZDA 3 1.6 TS Hatchback',
'transmission': 'manual',
'trim': 'TS',
'vin': 'JMZBL14Z201178362',
'year': 2010}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP10%2520OWU%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [bca.uk] INFO: Saving data for SP10%20OWU: {'auction_closing_time': 1774778400.0, 'created_time': 1774275528.369977, 'last_price_update_time': 1774695804.35384}
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP10%2520OWU') HTTP/1.1" 204 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786889%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786889 not downloaded yet
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293617%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293617 not downloaded yet
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ab950>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775441%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775441/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e55c650>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775484%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775484/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23ca10>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796526%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796526/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e54f9d0>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796530%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796530/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3b6d0>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775462%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775462/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e55d190>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775518%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775518/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5cfa90>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698802008%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802008/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2554d0>
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818563%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818563/600 saved to cache
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:03:24 [bca.uk] INFO: Found listing with ID: SP13%20OYM
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520OYM%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [bca.uk] INFO: Scrape type for SP13%20OYM: 2
2026-03-28 11:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5298dde4-f808-56dd-8a8c-96ee9ce796e5 with identifier: SP13%20OYM
2026-03-28 11:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5298dde4-f808-56dd-8a8c-96ee9ce796e5 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5298dde4-f808-56dd-8a8c-96ee9ce796e5 with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5298dde4-f808-56dd-8a8c-96ee9ce796e5, identifier: SP13%20OYM
2026-03-28 11:03:24 [bca.uk] INFO: Found listing with ID: VN67%20AUR
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN67%2520AUR%27 HTTP/1.1" 200 None
2026-03-28 11:03:24 [bca.uk] INFO: Scrape type for VN67%20AUR: 2
2026-03-28 11:03:24 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb0f96e6-0442-550d-a0c8-fd278c0bca2b with identifier: VN67%20AUR
2026-03-28 11:03:24 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bb0f96e6-0442-550d-a0c8-fd278c0bca2b with scrape type 2
2026-03-28 11:03:24 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bb0f96e6-0442-550d-a0c8-fd278c0bca2b with scrape type 2
2026-03-28 11:03:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb0f96e6-0442-550d-a0c8-fd278c0bca2b, identifier: VN67%20AUR
2026-03-28 11:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5298dde4-f808-56dd-8a8c-96ee9ce796e5 with identifier: SP13%20OYM
2026-03-28 11:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5298dde4-f808-56dd-8a8c-96ee9ce796e5 with identifier: SP13%20OYM
2026-03-28 11:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5298dde4-f808-56dd-8a8c-96ee9ce796e5 with identifier: SP13%20OYM to the API
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP13%20OYM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5298dde4-f808-56dd-8a8c-96ee9ce796e5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP13 OYM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP13%20OYM&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'FORD',
'model': 'MONDEO',
'odometer': 117780,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD MONDEO 1.6 E/B 160 ZETEC S/S Hatchback',
'transmission': 'manual',
'trim': 'E/B 160 ZETEC S/S',
'vin': 'WF0EXXGBBECA70473',
'year': 2013}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520OYM%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [bca.uk] INFO: Saving data for SP13%20OYM: {'auction_closing_time': 1774778400.0, 'created_time': 1774479531.88704, 'last_price_update_time': 1774695805.315334}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP13%2520OYM') HTTP/1.1" 204 0
2026-03-28 11:03:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb0f96e6-0442-550d-a0c8-fd278c0bca2b with identifier: VN67%20AUR
2026-03-28 11:03:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb0f96e6-0442-550d-a0c8-fd278c0bca2b with identifier: VN67%20AUR
2026-03-28 11:03:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb0f96e6-0442-550d-a0c8-fd278c0bca2b with identifier: VN67%20AUR to the API
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN67%20AUR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bb0f96e6-0442-550d-a0c8-fd278c0bca2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN67 AUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN67%20AUR&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'SKODA',
'model': 'OCTAVIA SCOUT',
'odometer': 102974,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA SCOUT 2.0 TDI 184 4X4 DSG Estate',
'transmission': 'automatic',
'trim': 'TDI 184 4X4 DSG',
'vin': 'TMBMK7NE5J0126641',
'year': 2017}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN67%2520AUR%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [bca.uk] INFO: Saving data for VN67%20AUR: {'auction_closing_time': 1774864800.0, 'created_time': 1774044521.385735, 'last_price_update_time': 1774695805.802141}
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN67%2520AUR') HTTP/1.1" 204 0
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698786902%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786902 not downloaded yet
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698293624%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293624 not downloaded yet
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793656>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796913>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX64%20WYR-GB>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786820>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293604/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293604>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793670>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DH66%20OBL-GB>
2026-03-28 11:03:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802076>
2026-03-28 11:03:25 [bca.uk] INFO: Found listing with ID: SP61%20YBE
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP61%2520YBE%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [bca.uk] INFO: Scrape type for SP61%20YBE: 0
2026-03-28 11:03:25 [bca.uk] INFO: Found listing with ID: ST61%20AZU
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST61%2520AZU%27 HTTP/1.1" 200 None
2026-03-28 11:03:25 [bca.uk] INFO: Scrape type for ST61%20AZU: 2
2026-03-28 11:03:25 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3f6e60f-4ba5-5691-b3a2-86ec010d9917 with identifier: ST61%20AZU
2026-03-28 11:03:25 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3f6e60f-4ba5-5691-b3a2-86ec010d9917 with scrape type 2
2026-03-28 11:03:25 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3f6e60f-4ba5-5691-b3a2-86ec010d9917 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3f6e60f-4ba5-5691-b3a2-86ec010d9917, identifier: ST61%20AZU
2026-03-28 11:03:26 [bca.uk] INFO: Found listing with ID: AV56%20LPL
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520LPL%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [bca.uk] INFO: Scrape type for AV56%20LPL: 2
2026-03-28 11:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8f33921-e587-5b52-90c3-ede066d916e0 with identifier: AV56%20LPL
2026-03-28 11:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8f33921-e587-5b52-90c3-ede066d916e0 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8f33921-e587-5b52-90c3-ede066d916e0 with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8f33921-e587-5b52-90c3-ede066d916e0, identifier: AV56%20LPL
2026-03-28 11:03:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e859050>
2026-03-28 11:03:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801918%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801918/600 saved to cache
2026-03-28 11:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3f6e60f-4ba5-5691-b3a2-86ec010d9917 with identifier: ST61%20AZU
2026-03-28 11:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3f6e60f-4ba5-5691-b3a2-86ec010d9917 with identifier: ST61%20AZU
2026-03-28 11:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3f6e60f-4ba5-5691-b3a2-86ec010d9917 with identifier: ST61%20AZU to the API
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 174,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ST61%20AZU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f3f6e60f-4ba5-5691-b3a2-86ec010d9917',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ST61 AZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ST61%20AZU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'FORD',
'model': 'S-MAX',
'odometer': 97425,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FORD S-MAX 2.2 TDCI 200 TITANIUM X SPORT MPV',
'transmission': 'manual',
'trim': 'TDCI 200 TITANIUM X SPORT',
'vin': 'WF0SXXGBWSBM12973',
'year': 2011}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST61%2520AZU%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [bca.uk] INFO: Saving data for ST61%20AZU: {'auction_closing_time': 1774778400.0, 'created_time': 1774477850.713466, 'last_price_update_time': 1774695806.514274}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ST61%2520AZU') HTTP/1.1" 204 0
2026-03-28 11:03:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8f33921-e587-5b52-90c3-ede066d916e0 with identifier: AV56%20LPL
2026-03-28 11:03:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8f33921-e587-5b52-90c3-ede066d916e0 with identifier: AV56%20LPL
2026-03-28 11:03:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8f33921-e587-5b52-90c3-ede066d916e0 with identifier: AV56%20LPL to the API
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV56%20LPL-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd8f33921-e587-5b52-90c3-ede066d916e0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV56 LPL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV56%20LPL&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 59539,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE CVT-7',
'vin': 'JHMGD18506S236465',
'year': 2006}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520LPL%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [bca.uk] INFO: Saving data for AV56%20LPL: {'auction_closing_time': 1774864800.0, 'created_time': 1774504902.443006, 'last_price_update_time': 1774695806.851406}
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV56%2520LPL') HTTP/1.1" 204 0
2026-03-28 11:03:26 [bca.uk] INFO: Found listing with ID: SY60%20MFJ
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY60%2520MFJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:26 [bca.uk] INFO: Scrape type for SY60%20MFJ: 2
2026-03-28 11:03:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 792af3c3-ba61-5005-a754-5963dcc6db2c with identifier: SY60%20MFJ
2026-03-28 11:03:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 792af3c3-ba61-5005-a754-5963dcc6db2c with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 792af3c3-ba61-5005-a754-5963dcc6db2c with scrape type 2
2026-03-28 11:03:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 792af3c3-ba61-5005-a754-5963dcc6db2c, identifier: SY60%20MFJ
2026-03-28 11:03:26 [bca.uk] INFO: Found listing with ID: RO63%20LZW
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520LZW%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Scrape type for RO63%20LZW: 2
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7919a09-2c59-573b-85d4-34d254e3eb85 with identifier: RO63%20LZW
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c7919a09-2c59-573b-85d4-34d254e3eb85 with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c7919a09-2c59-573b-85d4-34d254e3eb85 with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c7919a09-2c59-573b-85d4-34d254e3eb85, identifier: RO63%20LZW
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793634/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786790/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:03:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293610>
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 792af3c3-ba61-5005-a754-5963dcc6db2c with identifier: SY60%20MFJ
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 792af3c3-ba61-5005-a754-5963dcc6db2c with identifier: SY60%20MFJ
2026-03-28 11:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 792af3c3-ba61-5005-a754-5963dcc6db2c with identifier: SY60%20MFJ to the API
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY60%20MFJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '792af3c3-ba61-5005-a754-5963dcc6db2c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY60 MFJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SY60%20MFJ&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'MAZDA',
'model': '3',
'odometer': 85580,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'MAZDA 3 1.6 TAKUYA Hatchback',
'transmission': 'manual',
'trim': 'TAKUYA',
'vin': 'JMZBL14Z201215257',
'year': 2010}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY60%2520MFJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Saving data for SY60%20MFJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774479531.532368, 'last_price_update_time': 1774695807.409919}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SY60%2520MFJ') HTTP/1.1" 204 0
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c7919a09-2c59-573b-85d4-34d254e3eb85 with identifier: RO63%20LZW
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c7919a09-2c59-573b-85d4-34d254e3eb85 with identifier: RO63%20LZW
2026-03-28 11:03:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c7919a09-2c59-573b-85d4-34d254e3eb85 with identifier: RO63%20LZW to the API
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO63%20LZW-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c7919a09-2c59-573b-85d4-34d254e3eb85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO63 LZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO63%20LZW&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 61877,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 177 BMT 4M R LINE DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 177 BMT 4M R LINE DSG',
'vin': 'WVGZZZ5NZEW020646',
'year': 2013}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520LZW%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Saving data for RO63%20LZW: {'auction_closing_time': 1774864800.0, 'created_time': 1774591756.853315, 'last_price_update_time': 1774695807.760808}
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO63%2520LZW') HTTP/1.1" 204 0
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:03:27 [bca.uk] INFO: Found listing with ID: WD22%20CCF
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD22%2520CCF%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Scrape type for WD22%20CCF: 0
2026-03-28 11:03:27 [bca.uk] INFO: Found listing with ID: YA73%20ESV
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA73%2520ESV%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Scrape type for YA73%20ESV: 1
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f74880c-6ef9-55be-9bdc-29c614fe9321 with identifier: YA73%20ESV
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:03:27 [bca.uk] INFO: Found listing with ID: WF60%20EZT
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF60%2520EZT%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Scrape type for WF60%20EZT: 0
2026-03-28 11:03:27 [bca.uk] INFO: Found listing with ID: YK18%20XZB
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK18%2520XZB%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Scrape type for YK18%20XZB: 0
2026-03-28 11:03:27 [bca.uk] INFO: Found listing with ID: DU18%20WDR
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU18%2520WDR%27 HTTP/1.1" 200 None
2026-03-28 11:03:27 [bca.uk] INFO: Scrape type for DU18%20WDR: 2
2026-03-28 11:03:27 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c973ee5a-815d-516c-b6fa-c1d70aa33a1b with identifier: DU18%20WDR
2026-03-28 11:03:27 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c973ee5a-815d-516c-b6fa-c1d70aa33a1b with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c973ee5a-815d-516c-b6fa-c1d70aa33a1b with scrape type 2
2026-03-28 11:03:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c973ee5a-815d-516c-b6fa-c1d70aa33a1b, identifier: DU18%20WDR
2026-03-28 11:03:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c973ee5a-815d-516c-b6fa-c1d70aa33a1b with identifier: DU18%20WDR
2026-03-28 11:03:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c973ee5a-815d-516c-b6fa-c1d70aa33a1b with identifier: DU18%20WDR
2026-03-28 11:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c973ee5a-815d-516c-b6fa-c1d70aa33a1b with identifier: DU18%20WDR to the API
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DU18%20WDR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c973ee5a-815d-516c-b6fa-c1d70aa33a1b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DU18 WDR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DU18%20WDR&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 40593,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 TEKNA XTRONIC Hatchback',
'transmission': 'automatic',
'trim': 'TEKNA XTRONIC',
'vin': 'SJNFBAF15U8009683',
'year': 2018}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU18%2520WDR%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Saving data for DU18%20WDR: {'auction_closing_time': 1774778400.0, 'created_time': 1774448290.758624, 'last_price_update_time': 1774695808.378826}
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DU18%2520WDR') HTTP/1.1" 204 0
2026-03-28 11:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293604/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: FG68%20YMS
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520YMS%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for FG68%20YMS: 0
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: HY14%20HKE
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY14%2520HKE%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for HY14%20HKE: 0
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: MM63%20YFL
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM63%2520YFL%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for MM63%20YFL: 0
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: OV17%20FPJ
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520FPJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for OV17%20FPJ: 0
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: WG65%20XOK
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG65%2520XOK%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for WG65%20XOK: 0
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: AO05%20HYJ
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO05%2520HYJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for AO05%20HYJ: 2
2026-03-28 11:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 16452b81-64b8-58d1-90aa-496939f45c0d with identifier: AO05%20HYJ
2026-03-28 11:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 16452b81-64b8-58d1-90aa-496939f45c0d with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 16452b81-64b8-58d1-90aa-496939f45c0d with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 16452b81-64b8-58d1-90aa-496939f45c0d, identifier: AO05%20HYJ
2026-03-28 11:03:28 [bca.uk] INFO: Found listing with ID: HV67%20OHJ
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV67%2520OHJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:28 [bca.uk] INFO: Scrape type for HV67%20OHJ: 2
2026-03-28 11:03:28 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 273efdc7-53ee-5a04-9b88-4d76b2d8ee94 with identifier: HV67%20OHJ
2026-03-28 11:03:28 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 273efdc7-53ee-5a04-9b88-4d76b2d8ee94 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 273efdc7-53ee-5a04-9b88-4d76b2d8ee94 with scrape type 2
2026-03-28 11:03:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 273efdc7-53ee-5a04-9b88-4d76b2d8ee94, identifier: HV67%20OHJ
2026-03-28 11:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:03:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:03:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 16452b81-64b8-58d1-90aa-496939f45c0d with identifier: AO05%20HYJ
2026-03-28 11:03:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 16452b81-64b8-58d1-90aa-496939f45c0d with identifier: AO05%20HYJ
2026-03-28 11:03:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 16452b81-64b8-58d1-90aa-496939f45c0d with identifier: AO05%20HYJ to the API
2026-03-28 11:03:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 165,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO05%20HYJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '16452b81-64b8-58d1-90aa-496939f45c0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO05 HYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO05%20HYJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '206',
'odometer': 62745,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'PEUGEOT 206 1.4 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'VF32AKFWR44767958',
'year': 2005}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO05%2520HYJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [bca.uk] INFO: Saving data for AO05%20HYJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774504974.192595, 'last_price_update_time': 1774695809.125558}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO05%2520HYJ') HTTP/1.1" 204 0
2026-03-28 11:03:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 273efdc7-53ee-5a04-9b88-4d76b2d8ee94 with identifier: HV67%20OHJ
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=multicoloured HTTP/1.1" 200 None
2026-03-28 11:03:29 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:03:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 273efdc7-53ee-5a04-9b88-4d76b2d8ee94 with identifier: HV67%20OHJ
2026-03-28 11:03:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 273efdc7-53ee-5a04-9b88-4d76b2d8ee94 with identifier: HV67%20OHJ to the API
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV67%20OHJ-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '273efdc7-53ee-5a04-9b88-4d76b2d8ee94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV67 OHJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV67%20OHJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 43537,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 90 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 DYNAMIQUE',
'vin': 'VF12R011558688788',
'year': 2017}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV67%2520OHJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:29 [bca.uk] INFO: Saving data for HV67%20OHJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774476820.225276, 'last_price_update_time': 1774695809.831895}
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV67%2520OHJ') HTTP/1.1" 204 0
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e859590>
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793634%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793634/600 saved to cache
2026-03-28 11:03:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e61dd10>
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786790%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786790/600 saved to cache
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc3ed0>
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293600%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293600/600 saved to cache
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e8350>
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796584%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796584/600 saved to cache
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d85d0>
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796868%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796868/600 saved to cache
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d0350>
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698802011%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802011/600 saved to cache
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:03:30 [bca.uk] INFO: Found listing with ID: OY17%20FYS
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520FYS%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [bca.uk] INFO: Scrape type for OY17%20FYS: 0
2026-03-28 11:03:30 [bca.uk] INFO: Found listing with ID: AK17%20YDS
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520YDS%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [bca.uk] INFO: Scrape type for AK17%20YDS: 2
2026-03-28 11:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f9bc13ba-824e-588e-a28e-cc2005789d16 with identifier: AK17%20YDS
2026-03-28 11:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f9bc13ba-824e-588e-a28e-cc2005789d16 with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f9bc13ba-824e-588e-a28e-cc2005789d16 with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f9bc13ba-824e-588e-a28e-cc2005789d16, identifier: AK17%20YDS
2026-03-28 11:03:30 [bca.uk] INFO: Found listing with ID: LC16%20CKE
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520CKE%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [bca.uk] INFO: Scrape type for LC16%20CKE: 0
2026-03-28 11:03:30 [bca.uk] INFO: Found listing with ID: MT61%20EPD
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520EPD%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [bca.uk] INFO: Scrape type for MT61%20EPD: 0
2026-03-28 11:03:30 [bca.uk] INFO: Found listing with ID: YA67%20SYU
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA67%2520SYU%27 HTTP/1.1" 200 None
2026-03-28 11:03:30 [bca.uk] INFO: Scrape type for YA67%20SYU: 2
2026-03-28 11:03:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab246cee-e230-5c8b-a56e-a8237b1dacae with identifier: YA67%20SYU
2026-03-28 11:03:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab246cee-e230-5c8b-a56e-a8237b1dacae with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab246cee-e230-5c8b-a56e-a8237b1dacae with scrape type 2
2026-03-28 11:03:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ab246cee-e230-5c8b-a56e-a8237b1dacae, identifier: YA67%20SYU
2026-03-28 11:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:03:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:03:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f9bc13ba-824e-588e-a28e-cc2005789d16 with identifier: AK17%20YDS
2026-03-28 11:03:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f9bc13ba-824e-588e-a28e-cc2005789d16 with identifier: AK17%20YDS
2026-03-28 11:03:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f9bc13ba-824e-588e-a28e-cc2005789d16 with identifier: AK17%20YDS to the API
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK17%20YDS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f9bc13ba-824e-588e-a28e-cc2005789d16',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK17 YDS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK17%20YDS&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 87755,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 1.5 TDCI 120 ZETEC P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 120 ZETEC P/S',
'vin': 'WF0WXXGCEWHJ11273',
'year': 2017}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520YDS%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [bca.uk] INFO: Saving data for AK17%20YDS: {'auction_closing_time': 1774864800.0, 'created_time': 1774591868.417254, 'last_price_update_time': 1774695811.343858}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK17%2520YDS') HTTP/1.1" 204 0
2026-03-28 11:03:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ab246cee-e230-5c8b-a56e-a8237b1dacae with identifier: YA67%20SYU
2026-03-28 11:03:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ab246cee-e230-5c8b-a56e-a8237b1dacae with identifier: YA67%20SYU
2026-03-28 11:03:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ab246cee-e230-5c8b-a56e-a8237b1dacae with identifier: YA67%20SYU to the API
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA67%20SYU-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ab246cee-e230-5c8b-a56e-a8237b1dacae',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA67 SYU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA67%20SYU&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'CITROEN',
'model': 'C1',
'odometer': 36095,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.2 P/T 82 FLAIR Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 FLAIR',
'vin': 'VF7PAHMTCHR813038',
'year': 2017}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA67%2520SYU%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [bca.uk] INFO: Saving data for YA67%20SYU: {'auction_closing_time': 1774778400.0, 'created_time': 1774564693.371767, 'last_price_update_time': 1774695811.737596}
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA67%2520SYU') HTTP/1.1" 204 0
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc1490>
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_expert_report_file_e19f2ae6-3516-4aa2-8932-412f31da8c63.pdf HTTP/1.1" 201 0
2026-03-28 11:03:31 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:31 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28ab50ea-4f5a-545f-b49b-8b86322ed399, skipping ID generation
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWF61VPM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WF61VPM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf5f90>
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293604%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293604/600 saved to cache
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786902>
2026-03-28 11:03:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293624>
2026-03-28 11:03:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:03:31 [bca.uk] INFO: Found listing with ID: CF17%20BZG
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF17%2520BZG%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [bca.uk] INFO: Scrape type for CF17%20BZG: 0
2026-03-28 11:03:31 [bca.uk] INFO: Found listing with ID: CV65%20ZBZ
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:31 [bca.uk] INFO: Scrape type for CV65%20ZBZ: 2
2026-03-28 11:03:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba with identifier: CV65%20ZBZ
2026-03-28 11:03:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba with scrape type 2
2026-03-28 11:03:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba, identifier: CV65%20ZBZ
2026-03-28 11:03:32 [bca.uk] INFO: Found listing with ID: FV17%20CRF
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520CRF%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [bca.uk] INFO: Scrape type for FV17%20CRF: 0
2026-03-28 11:03:32 [bca.uk] INFO: Found listing with ID: PG68%20MPV
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG68%2520MPV%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [bca.uk] INFO: Scrape type for PG68%20MPV: 2
2026-03-28 11:03:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e with identifier: PG68%20MPV
2026-03-28 11:03:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e with scrape type 2
2026-03-28 11:03:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e, identifier: PG68%20MPV
2026-03-28 11:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba with identifier: CV65%20ZBZ
2026-03-28 11:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba with identifier: CV65%20ZBZ
2026-03-28 11:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba with identifier: CV65%20ZBZ to the API
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV65%20ZBZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3bbd306c-8bd2-5aa7-b4d7-10ee0a6ca8ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CV65 ZBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV65%20ZBZ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 115519,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 HSE StationWagon',
'transmission': 'manual',
'trim': 'SDV6 306 HSE',
'vin': 'SALWA2KE4GA554912',
'year': 2015}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV65%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [bca.uk] INFO: Saving data for CV65%20ZBZ: {'auction_closing_time': 1774864800.0, 'created_time': 1773929472.786704, 'last_price_update_time': 1774695812.549205}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV65%2520ZBZ') HTTP/1.1" 204 0
2026-03-28 11:03:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e with identifier: PG68%20MPV
2026-03-28 11:03:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e with identifier: PG68%20MPV
2026-03-28 11:03:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 50beb496-1f36-5eb5-80cc-5e5d9b8ba10e with identifier: PG68%20MPV to the API
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PG68%20MPV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '50beb496-1f36-5eb5-80cc-5e5d9b8ba10e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PG68 MPV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PG68%20MPV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'AUDI',
'model': 'A6 AVANT',
'odometer': 100356,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'AUDI A6 AVANT 2.0 40 TDI SPORT S-T Estate',
'transmission': 'automatic',
'trim': '40 TDI SPORT S-T',
'vin': 'WAUZZZF21KN022795',
'year': 2019}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG68%2520MPV%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [bca.uk] INFO: Saving data for PG68%20MPV: {'auction_closing_time': 1774864800.0, 'created_time': 1774361874.752988, 'last_price_update_time': 1774695812.956731}
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PG68%2520MPV') HTTP/1.1" 204 0
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602553%27 HTTP/1.1" 200 None
2026-03-28 11:03:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602553 not downloaded yet
2026-03-28 11:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793693/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793693>
2026-03-28 11:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786889>
2026-03-28 11:03:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293617>
2026-03-28 11:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW15%20UPM-GB>
2026-03-28 11:03:33 [bca.uk] INFO: Found listing with ID: FA52%20BEL
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA52%2520BEL%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [bca.uk] INFO: Scrape type for FA52%20BEL: 0
2026-03-28 11:03:33 [bca.uk] INFO: Found listing with ID: FE65%20VCD
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520VCD%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [bca.uk] INFO: Scrape type for FE65%20VCD: 2
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88dd4ddd-412e-5778-b47c-8ea302243da3 with identifier: FE65%20VCD
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88dd4ddd-412e-5778-b47c-8ea302243da3 with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88dd4ddd-412e-5778-b47c-8ea302243da3 with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 88dd4ddd-412e-5778-b47c-8ea302243da3, identifier: FE65%20VCD
2026-03-28 11:03:33 [bca.uk] INFO: Found listing with ID: AK58%20VZY
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520VZY%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [bca.uk] INFO: Scrape type for AK58%20VZY: 2
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6c6bfd06-a003-5255-b592-1e25337b902d with identifier: AK58%20VZY
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6c6bfd06-a003-5255-b592-1e25337b902d with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6c6bfd06-a003-5255-b592-1e25337b902d with scrape type 2
2026-03-28 11:03:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6c6bfd06-a003-5255-b592-1e25337b902d, identifier: AK58%20VZY
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb82650>
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793670%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793670/600 saved to cache
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f8ad0>
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698802076%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802076/600 saved to cache
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff13750>
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_expert_report_file_d6eb9230-fd10-4477-9a1e-ee01f516b2bc.pdf HTTP/1.1" 201 0
2026-03-28 11:03:33 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb019db5-f305-538c-b142-6039ad8ff322, skipping ID generation
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDH66OBL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DH66OBL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea78d0>
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786820%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786820/600 saved to cache
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8eb550>
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793656%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793656/600 saved to cache
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea7810>
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796913%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796913/600 saved to cache
2026-03-28 11:03:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG09%20CXU-GB>
2026-03-28 11:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786870>
2026-03-28 11:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA73%20ESV-GB>
2026-03-28 11:03:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793685>
2026-03-28 11:03:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 88dd4ddd-412e-5778-b47c-8ea302243da3 with identifier: FE65%20VCD
2026-03-28 11:03:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 88dd4ddd-412e-5778-b47c-8ea302243da3 with identifier: FE65%20VCD
2026-03-28 11:03:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 88dd4ddd-412e-5778-b47c-8ea302243da3 with identifier: FE65%20VCD to the API
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FE65%20VCD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '88dd4ddd-412e-5778-b47c-8ea302243da3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FE65 VCD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FE65%20VCD&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 62295,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC',
'vin': 'SALVA2AN3GH086854',
'year': 2015}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520VCD%27 HTTP/1.1" 200 None
2026-03-28 11:03:33 [bca.uk] INFO: Saving data for FE65%20VCD: {'auction_closing_time': 1774864800.0, 'created_time': 1774504972.445716, 'last_price_update_time': 1774695813.930656}
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FE65%2520VCD') HTTP/1.1" 204 0
2026-03-28 11:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6c6bfd06-a003-5255-b592-1e25337b902d with identifier: AK58%20VZY
2026-03-28 11:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6c6bfd06-a003-5255-b592-1e25337b902d with identifier: AK58%20VZY
2026-03-28 11:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6c6bfd06-a003-5255-b592-1e25337b902d with identifier: AK58%20VZY to the API
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 194,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK58%20VZY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6c6bfd06-a003-5255-b592-1e25337b902d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK58 VZY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK58%20VZY&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'EOS',
'odometer': 113098,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN EOS 2.0 T FSI SPORT DSG Convertible',
'transmission': 'automatic',
'trim': 'T FSI SPORT DSG',
'vin': 'WVWZZZ1FZ8V052573',
'year': 2008}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK58%2520VZY%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [bca.uk] INFO: Saving data for AK58%20VZY: {'auction_closing_time': 1774864800.0, 'created_time': 1774591754.815272, 'last_price_update_time': 1774695814.446165}
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK58%2520VZY') HTTP/1.1" 204 0
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602567%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602567 not downloaded yet
2026-03-28 11:03:34 [bca.uk] INFO: Found listing with ID: K40%20VNB
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K40%2520VNB%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [bca.uk] INFO: Scrape type for K40%20VNB: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6dd69a0-e800-56aa-a58c-df50fe7cfeb7 with identifier: K40%20VNB
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c6dd69a0-e800-56aa-a58c-df50fe7cfeb7 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c6dd69a0-e800-56aa-a58c-df50fe7cfeb7 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c6dd69a0-e800-56aa-a58c-df50fe7cfeb7, identifier: K40%20VNB
2026-03-28 11:03:34 [bca.uk] INFO: Found listing with ID: J17%20SDL
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J17%2520SDL%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [bca.uk] INFO: Scrape type for J17%20SDL: 0
2026-03-28 11:03:34 [bca.uk] INFO: Found listing with ID: LW02%20GAV
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW02%2520GAV%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [bca.uk] INFO: Scrape type for LW02%20GAV: 2
2026-03-28 11:03:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f69adef9-e9f6-5ba3-8d7b-7e697acadc19 with identifier: LW02%20GAV
2026-03-28 11:03:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f69adef9-e9f6-5ba3-8d7b-7e697acadc19 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f69adef9-e9f6-5ba3-8d7b-7e697acadc19 with scrape type 2
2026-03-28 11:03:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f69adef9-e9f6-5ba3-8d7b-7e697acadc19, identifier: LW02%20GAV
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813705%27 HTTP/1.1" 200 None
2026-03-28 11:03:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813705 not downloaded yet
2026-03-28 11:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802097>
2026-03-28 11:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796927>
2026-03-28 11:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786847>
2026-03-28 11:03:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293607>
2026-03-28 11:03:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c6dd69a0-e800-56aa-a58c-df50fe7cfeb7 with identifier: K40%20VNB
2026-03-28 11:03:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c6dd69a0-e800-56aa-a58c-df50fe7cfeb7 with identifier: K40%20VNB
2026-03-28 11:03:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c6dd69a0-e800-56aa-a58c-df50fe7cfeb7 with identifier: K40%20VNB to the API
2026-03-28 11:03:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=K40%20VNB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c6dd69a0-e800-56aa-a58c-df50fe7cfeb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'K40 VNB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=K40%20VNB&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': '420D',
'odometer': 108584,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW 420D 2.0 190 M SPORT STEP Coupe',
'transmission': 'automatic',
'trim': '190 M SPORT STEP',
'vin': 'WBA4P72090K719171',
'year': 2016}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K40%2520VNB%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [bca.uk] INFO: Saving data for K40%20VNB: {'auction_closing_time': 1774864800.0, 'created_time': 1774591834.130596, 'last_price_update_time': 1774695815.205127}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='K40%2520VNB') HTTP/1.1" 204 0
2026-03-28 11:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f69adef9-e9f6-5ba3-8d7b-7e697acadc19 with identifier: LW02%20GAV
2026-03-28 11:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f69adef9-e9f6-5ba3-8d7b-7e697acadc19 with identifier: LW02%20GAV
2026-03-28 11:03:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f69adef9-e9f6-5ba3-8d7b-7e697acadc19 with identifier: LW02%20GAV to the API
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 265,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LW02%20GAV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f69adef9-e9f6-5ba3-8d7b-7e697acadc19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LW02 GAV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LW02%20GAV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 101712,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.7 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAA138A175698',
'year': 2009}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW02%2520GAV%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [bca.uk] INFO: Saving data for LW02%20GAV: {'auction_closing_time': 1774864800.0, 'created_time': 1774591747.999416, 'last_price_update_time': 1774695815.539822}
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LW02%2520GAV') HTTP/1.1" 204 0
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602580%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602580 not downloaded yet
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8f4490>
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_expert_report_file_82313c16-684c-461c-9356-f6a579e96cad.pdf HTTP/1.1" 201 0
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4eccf9d-8001-5d5e-9db1-5dec162636ac, skipping ID generation
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKX64WYR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX64WYR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e609ad0>
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293610%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293610/600 saved to cache
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796603>
2026-03-28 11:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:03:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD60%20AGX-GB>
2026-03-28 11:03:35 [bca.uk] INFO: Found listing with ID: MF16%20GHO
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520GHO%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [bca.uk] INFO: Scrape type for MF16%20GHO: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4641462c-2bf7-5137-820d-94e8a09b21cc with identifier: MF16%20GHO
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4641462c-2bf7-5137-820d-94e8a09b21cc with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4641462c-2bf7-5137-820d-94e8a09b21cc with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4641462c-2bf7-5137-820d-94e8a09b21cc, identifier: MF16%20GHO
2026-03-28 11:03:35 [bca.uk] INFO: Found listing with ID: YH62%20JFG
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH62%2520JFG%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [bca.uk] INFO: Scrape type for YH62%20JFG: 2
2026-03-28 11:03:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c88ae957-3693-5b16-b2b2-b753c6c8d4b4 with identifier: YH62%20JFG
2026-03-28 11:03:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c88ae957-3693-5b16-b2b2-b753c6c8d4b4 with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c88ae957-3693-5b16-b2b2-b753c6c8d4b4 with scrape type 2
2026-03-28 11:03:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c88ae957-3693-5b16-b2b2-b753c6c8d4b4, identifier: YH62%20JFG
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813718%27 HTTP/1.1" 200 None
2026-03-28 11:03:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813718 not downloaded yet
2026-03-28 11:03:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:03:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4641462c-2bf7-5137-820d-94e8a09b21cc with identifier: MF16%20GHO
2026-03-28 11:03:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4641462c-2bf7-5137-820d-94e8a09b21cc with identifier: MF16%20GHO
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4641462c-2bf7-5137-820d-94e8a09b21cc with identifier: MF16%20GHO to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF16%20GHO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4641462c-2bf7-5137-820d-94e8a09b21cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF16 GHO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF16%20GHO&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MERCEDES-BENZ',
'model': 'C220 D',
'odometer': 73989,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 D 2.1 AMG LINE Coupe',
'transmission': 'manual',
'trim': 'AMG LINE',
'vin': 'WDD2053042F340952',
'year': 2016}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF16%2520GHO%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [bca.uk] INFO: Saving data for MF16%20GHO: {'auction_closing_time': 1774864800.0, 'created_time': 1774591793.054319, 'last_price_update_time': 1774695816.248277}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF16%2520GHO') HTTP/1.1" 204 0
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c88ae957-3693-5b16-b2b2-b753c6c8d4b4 with identifier: YH62%20JFG
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c88ae957-3693-5b16-b2b2-b753c6c8d4b4 with identifier: YH62%20JFG
2026-03-28 11:03:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c88ae957-3693-5b16-b2b2-b753c6c8d4b4 with identifier: YH62%20JFG to the API
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH62%20JFG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.1L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c88ae957-3693-5b16-b2b2-b753c6c8d4b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH62 JFG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH62%20JFG&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 82505,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 CDI B/E AMG SPORT Coupe',
'transmission': 'manual',
'trim': 'CDI B/E AMG SPORT',
'vin': 'WDD2043022F992878',
'year': 2012}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH62%2520JFG%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [bca.uk] INFO: Saving data for YH62%20JFG: {'auction_closing_time': 1774864800.0, 'created_time': 1774591731.558568, 'last_price_update_time': 1774695816.616411}
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH62%2520JFG') HTTP/1.1" 204 0
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602592%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602592 not downloaded yet
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587774%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587774 not downloaded yet
2026-03-28 11:03:36 [bca.uk] INFO: Found listing with ID: HX05%20UJS
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX05%2520UJS%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [bca.uk] INFO: Scrape type for HX05%20UJS: 2
2026-03-28 11:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa with identifier: HX05%20UJS
2026-03-28 11:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa, identifier: HX05%20UJS
2026-03-28 11:03:36 [bca.uk] INFO: Found listing with ID: YC13%20HCU
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520HCU%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [bca.uk] INFO: Scrape type for YC13%20HCU: 2
2026-03-28 11:03:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4fd3ed77-2be3-5968-9ef0-411fdaac7488 with identifier: YC13%20HCU
2026-03-28 11:03:36 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4fd3ed77-2be3-5968-9ef0-411fdaac7488 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4fd3ed77-2be3-5968-9ef0-411fdaac7488 with scrape type 2
2026-03-28 11:03:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4fd3ed77-2be3-5968-9ef0-411fdaac7488, identifier: YC13%20HCU
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813739%27 HTTP/1.1" 200 None
2026-03-28 11:03:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813739 not downloaded yet
2026-03-28 11:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793693/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:03:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:03:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa with identifier: HX05%20UJS
2026-03-28 11:03:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa with identifier: HX05%20UJS
2026-03-28 11:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa with identifier: HX05%20UJS to the API
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HX05%20UJS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f0dd2d77-8cd2-5d8b-98b1-d79dea2d44fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HX05 UJS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HX05%20UJS&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 71920,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 GHIA Hatchback',
'transmission': 'automatic',
'trim': 'GHIA',
'vin': 'WF05XXWPD55B16328',
'year': 2005}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX05%2520UJS%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Saving data for HX05%20UJS: {'auction_closing_time': 1774864800.0, 'created_time': 1774015821.70353, 'last_price_update_time': 1774695817.305215}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HX05%2520UJS') HTTP/1.1" 204 0
2026-03-28 11:03:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4fd3ed77-2be3-5968-9ef0-411fdaac7488 with identifier: YC13%20HCU
2026-03-28 11:03:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4fd3ed77-2be3-5968-9ef0-411fdaac7488 with identifier: YC13%20HCU
2026-03-28 11:03:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4fd3ed77-2be3-5968-9ef0-411fdaac7488 with identifier: YC13%20HCU to the API
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 294,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC13%20HCU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4fd3ed77-2be3-5968-9ef0-411fdaac7488',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC13 HCU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC13%20HCU&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'CASCADA',
'odometer': 62742,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VAUXHALL CASCADA 2.0 CDTI 165 SE Convertible',
'transmission': 'manual',
'trim': 'CDTI 165 SE',
'vin': 'W0LWR3DN5DG084755',
'year': 2013}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520HCU%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Saving data for YC13%20HCU: {'auction_closing_time': 1774778400.0, 'created_time': 1773845122.143921, 'last_price_update_time': 1774695817.69492}
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC13%2520HCU') HTTP/1.1" 204 0
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602615%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602615 not downloaded yet
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587789%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587789 not downloaded yet
2026-03-28 11:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:03:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:03:37 [bca.uk] INFO: Found listing with ID: KR09%20WWZ
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR09%2520WWZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Scrape type for KR09%20WWZ: 0
2026-03-28 11:03:37 [bca.uk] INFO: Found listing with ID: LG11%20BUP
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG11%2520BUP%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Scrape type for LG11%20BUP: 0
2026-03-28 11:03:37 [bca.uk] INFO: Found listing with ID: LT56%20FLZ
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT56%2520FLZ%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Scrape type for LT56%20FLZ: 0
2026-03-28 11:03:37 [bca.uk] INFO: Found listing with ID: SG11%20EMV
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG11%2520EMV%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Scrape type for SG11%20EMV: 0
2026-03-28 11:03:37 [bca.uk] INFO: Found listing with ID: CA57%20XLV
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520XLV%27 HTTP/1.1" 200 None
2026-03-28 11:03:37 [bca.uk] INFO: Scrape type for CA57%20XLV: 2
2026-03-28 11:03:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3844e120-fb61-5c9b-86d6-ac980b8762b2 with identifier: CA57%20XLV
2026-03-28 11:03:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3844e120-fb61-5c9b-86d6-ac980b8762b2 with scrape type 2
2026-03-28 11:03:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3844e120-fb61-5c9b-86d6-ac980b8762b2 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3844e120-fb61-5c9b-86d6-ac980b8762b2, identifier: CA57%20XLV
2026-03-28 11:03:38 [bca.uk] INFO: Found listing with ID: YG63%20XGU
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG63%2520XGU%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [bca.uk] INFO: Scrape type for YG63%20XGU: 0
2026-03-28 11:03:38 [bca.uk] INFO: Found listing with ID: YG64%20YTB
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520YTB%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [bca.uk] INFO: Scrape type for YG64%20YTB: 2
2026-03-28 11:03:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c37fdeb8-de56-5ce5-83de-5702fea5cb77 with identifier: YG64%20YTB
2026-03-28 11:03:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c37fdeb8-de56-5ce5-83de-5702fea5cb77 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c37fdeb8-de56-5ce5-83de-5702fea5cb77 with scrape type 2
2026-03-28 11:03:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c37fdeb8-de56-5ce5-83de-5702fea5cb77, identifier: YG64%20YTB
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813751%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813751 not downloaded yet
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e609fd0>
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786902%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786902/600 saved to cache
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdd5d90>
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293624%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293624/600 saved to cache
2026-03-28 11:03:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3844e120-fb61-5c9b-86d6-ac980b8762b2 with identifier: CA57%20XLV
2026-03-28 11:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3844e120-fb61-5c9b-86d6-ac980b8762b2 with identifier: CA57%20XLV
2026-03-28 11:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3844e120-fb61-5c9b-86d6-ac980b8762b2 with identifier: CA57%20XLV to the API
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CA57%20XLV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3844e120-fb61-5c9b-86d6-ac980b8762b2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CA57 XLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CA57%20XLV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 116109,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 VVT LIFE Estate',
'transmission': 'automatic',
'trim': 'VVT LIFE',
'vin': 'W0L0AHL3582086952',
'year': 2008}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA57%2520XLV%27 HTTP/1.1" 200 None
2026-03-28 11:03:38 [bca.uk] INFO: Saving data for CA57%20XLV: {'auction_closing_time': 1774778400.0, 'created_time': 1774390042.591949, 'last_price_update_time': 1774695818.583983}
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CA57%2520XLV') HTTP/1.1" 204 0
2026-03-28 11:03:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c37fdeb8-de56-5ce5-83de-5702fea5cb77 with identifier: YG64%20YTB
2026-03-28 11:03:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c37fdeb8-de56-5ce5-83de-5702fea5cb77 with identifier: YG64%20YTB
2026-03-28 11:03:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c37fdeb8-de56-5ce5-83de-5702fea5cb77 with identifier: YG64%20YTB to the API
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG64%20YTB-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c37fdeb8-de56-5ce5-83de-5702fea5cb77',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG64 YTB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG64%20YTB&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MAZDA',
'model': '6 TOURER',
'odometer': 139540,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MAZDA 6 TOURER 2.2 D 175 SPORT Estate',
'transmission': 'manual',
'trim': 'D 175 SPORT',
'vin': 'JMZGJ692621179380',
'year': 2014}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG64%2520YTB%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [bca.uk] INFO: Saving data for YG64%20YTB: {'auction_closing_time': 1774778400.0, 'created_time': 1774303458.319177, 'last_price_update_time': 1774695819.066089}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG64%2520YTB') HTTP/1.1" 204 0
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602644%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602644 not downloaded yet
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587804%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587804 not downloaded yet
2026-03-28 11:03:39 [bca.uk] INFO: Found listing with ID: SD67%20OYC
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520OYC%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [bca.uk] INFO: Scrape type for SD67%20OYC: 1
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e80eee89-7e00-5fcf-8fce-b398b8e41187 with identifier: SD67%20OYC
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:39 [bca.uk] INFO: Found listing with ID: EF13%20OTV
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF13%2520OTV%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [bca.uk] INFO: Scrape type for EF13%20OTV: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 918a30a8-9595-57ed-be33-8ccceb35f341 with identifier: EF13%20OTV
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 918a30a8-9595-57ed-be33-8ccceb35f341 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 918a30a8-9595-57ed-be33-8ccceb35f341 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 918a30a8-9595-57ed-be33-8ccceb35f341, identifier: EF13%20OTV
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813768%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813768 not downloaded yet
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2afed0>
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786889%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786889/600 saved to cache
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4e8cd0>
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793693%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793693/600 saved to cache
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac48fb50>
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293617%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293617/600 saved to cache
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 918a30a8-9595-57ed-be33-8ccceb35f341 with identifier: EF13%20OTV
2026-03-28 11:03:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 918a30a8-9595-57ed-be33-8ccceb35f341 with identifier: EF13%20OTV
2026-03-28 11:03:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 918a30a8-9595-57ed-be33-8ccceb35f341 with identifier: EF13%20OTV to the API
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 88,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF13%20OTV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '918a30a8-9595-57ed-be33-8ccceb35f341',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF13 OTV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF13%20OTV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 110303,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 105 ECONETIC EDGE Hatchback',
'transmission': 'manual',
'trim': 'TDCI 105 ECONETIC EDGE',
'vin': 'WF0KXXGCBKDJ64518',
'year': 2013}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF13%2520OTV%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [bca.uk] INFO: Saving data for EF13%20OTV: {'auction_closing_time': 1774778400.0, 'created_time': 1774419001.560597, 'last_price_update_time': 1774695819.799837}
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF13%2520OTV') HTTP/1.1" 204 0
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602670%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602670 not downloaded yet
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587822%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587822 not downloaded yet
2026-03-28 11:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:03:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:03:39 [bca.uk] INFO: Found listing with ID: BN07%20XHP
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN07%2520XHP%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [bca.uk] INFO: Scrape type for BN07%20XHP: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0ca8019-fab6-5cc9-a22c-aecb0bdef12a with identifier: BN07%20XHP
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0ca8019-fab6-5cc9-a22c-aecb0bdef12a with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0ca8019-fab6-5cc9-a22c-aecb0bdef12a with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0ca8019-fab6-5cc9-a22c-aecb0bdef12a, identifier: BN07%20XHP
2026-03-28 11:03:39 [bca.uk] INFO: Found listing with ID: FJ15%20XZU
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ15%2520XZU%27 HTTP/1.1" 200 None
2026-03-28 11:03:39 [bca.uk] INFO: Scrape type for FJ15%20XZU: 2
2026-03-28 11:03:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8 with identifier: FJ15%20XZU
2026-03-28 11:03:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8 with scrape type 2
2026-03-28 11:03:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8 with scrape type 2
2026-03-28 11:03:40 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8, identifier: FJ15%20XZU
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813802%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813802 not downloaded yet
2026-03-28 11:03:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813705>
2026-03-28 11:03:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0ca8019-fab6-5cc9-a22c-aecb0bdef12a with identifier: BN07%20XHP
2026-03-28 11:03:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0ca8019-fab6-5cc9-a22c-aecb0bdef12a with identifier: BN07%20XHP
2026-03-28 11:03:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0ca8019-fab6-5cc9-a22c-aecb0bdef12a with identifier: BN07%20XHP to the API
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN07%20XHP-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0ca8019-fab6-5cc9-a22c-aecb0bdef12a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN07 XHP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN07%20XHP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 83067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 LX Hatchback',
'transmission': 'automatic',
'trim': 'LX',
'vin': 'WF05XXWPD57K19279',
'year': 2007}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN07%2520XHP%27 HTTP/1.1" 200 None
2026-03-28 11:03:40 [bca.uk] INFO: Saving data for BN07%20XHP: {'auction_closing_time': 1774864800.0, 'created_time': 1774591838.328686, 'last_price_update_time': 1774695820.989289}
2026-03-28 11:03:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN07%2520XHP') HTTP/1.1" 204 0
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8 with identifier: FJ15%20XZU
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8 with identifier: FJ15%20XZU
2026-03-28 11:03:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8 with identifier: FJ15%20XZU to the API
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ15%20XZU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c94ddb59-d580-5fcf-a1a4-5ef67eeac6a8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ15 XZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ15%20XZU&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'INSIGNIA TOURER',
'odometer': 109899,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL INSIGNIA TOURER 2.0 CDTI E/F 140 DESIGN Estate',
'transmission': 'manual',
'trim': 'CDTI E/F 140 DESIGN',
'vin': 'W0LGM8ES5F1025960',
'year': 2015}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ15%2520XZU%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [bca.uk] INFO: Saving data for FJ15%20XZU: {'auction_closing_time': 1774778400.0, 'created_time': 1773930772.928824, 'last_price_update_time': 1774695821.512236}
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ15%2520XZU') HTTP/1.1" 204 0
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602689%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602689 not downloaded yet
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587837%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587837 not downloaded yet
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff4d9d0>
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_expert_report_file_c59d4f42-ace8-4270-94ef-126704094ef9.pdf HTTP/1.1" 201 0
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743, skipping ID generation
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBW15UPM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BW15UPM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff4cb90>
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793685%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793685/600 saved to cache
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff449d0>
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786870%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786870/600 saved to cache
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8dfb50>
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_expert_report_file_c5498ed1-a431-43eb-8101-6721c5f401c0.pdf HTTP/1.1" 201 0
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f74880c-6ef9-55be-9bdc-29c614fe9321, skipping ID generation
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYA73ESV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA73ESV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587755/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KX64WYR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:41 [bca.uk] INFO: Found listing with ID: FL60%20TTX
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL60%2520TTX%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [bca.uk] INFO: Scrape type for FL60%20TTX: 2
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1 with identifier: FL60%20TTX
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1 with scrape type 2
2026-03-28 11:03:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1, identifier: FL60%20TTX
2026-03-28 11:03:41 [bca.uk] INFO: Found listing with ID: GF62%20UBR
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF62%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [bca.uk] INFO: Scrape type for GF62%20UBR: 1
2026-03-28 11:03:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR
2026-03-28 11:03:41 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813826%27 HTTP/1.1" 200 None
2026-03-28 11:03:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813826 not downloaded yet
2026-03-28 11:03:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1 with identifier: FL60%20TTX
2026-03-28 11:03:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1 with identifier: FL60%20TTX
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 763b2a3c-f270-5d0d-85b1-3f770c2ecbd1 with identifier: FL60%20TTX to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL60%20TTX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '763b2a3c-f270-5d0d-85b1-3f770c2ecbd1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL60 TTX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL60%20TTX&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 95759,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TITANIUM Hatchback',
'transmission': 'automatic',
'trim': 'TITANIUM',
'vin': 'WF0JXXGAJJAJ32928',
'year': 2010}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL60%2520TTX%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [bca.uk] INFO: Saving data for FL60%20TTX: {'auction_closing_time': 1774864800.0, 'created_time': 1774504909.209435, 'last_price_update_time': 1774695822.269814}
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL60%2520TTX') HTTP/1.1" 204 0
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602712%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602712 not downloaded yet
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587862%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587862 not downloaded yet
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483504%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483504 not downloaded yet
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767919%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767919 not downloaded yet
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac47d410>
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_expert_report_file_4c33048a-f5d8-4096-aca8-7c8a184a7b8e.pdf HTTP/1.1" 201 0
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8, skipping ID generation
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWG09CXU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WG09CXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac375390>
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796927%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796927/600 saved to cache
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2abd90>
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796603%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796603/600 saved to cache
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac116ad0>
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293607%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293607/600 saved to cache
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c2850>
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786847%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786847/600 saved to cache
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac115890>
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698802097%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802097/600 saved to cache
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813739>
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602580/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602580>
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602592>
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813718>
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602567>
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587774>
2026-03-28 11:03:42 [bca.uk] INFO: Found listing with ID: KN09%20JZF
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN09%2520JZF%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [bca.uk] INFO: Scrape type for KN09%20JZF: 2
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b5c23bdf-8112-51d4-b3ee-7ca3df8730ab with identifier: KN09%20JZF
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b5c23bdf-8112-51d4-b3ee-7ca3df8730ab with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b5c23bdf-8112-51d4-b3ee-7ca3df8730ab with scrape type 2
2026-03-28 11:03:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b5c23bdf-8112-51d4-b3ee-7ca3df8730ab, identifier: KN09%20JZF
2026-03-28 11:03:42 [bca.uk] INFO: Found listing with ID: HV62%20WPN
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV62%2520WPN%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [bca.uk] INFO: Scrape type for HV62%20WPN: 0
2026-03-28 11:03:42 [bca.uk] INFO: Found listing with ID: MT61%20NXP
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520NXP%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [bca.uk] INFO: Scrape type for MT61%20NXP: 0
2026-03-28 11:03:42 [bca.uk] INFO: Found listing with ID: PK58%20XAE
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK58%2520XAE%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [bca.uk] INFO: Scrape type for PK58%20XAE: 1
2026-03-28 11:03:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE
2026-03-28 11:03:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813859%27 HTTP/1.1" 200 None
2026-03-28 11:03:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813859 not downloaded yet
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813751>
2026-03-28 11:03:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587804/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587804>
2026-03-28 11:03:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b5c23bdf-8112-51d4-b3ee-7ca3df8730ab with identifier: KN09%20JZF
2026-03-28 11:03:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b5c23bdf-8112-51d4-b3ee-7ca3df8730ab with identifier: KN09%20JZF
2026-03-28 11:03:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b5c23bdf-8112-51d4-b3ee-7ca3df8730ab with identifier: KN09%20JZF to the API
2026-03-28 11:03:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN09%20JZF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b5c23bdf-8112-51d4-b3ee-7ca3df8730ab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN09 JZF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN09%20JZF&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 91984,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'SMART FORTWO 1.0 (84) PASSION Coupe',
'transmission': 'automatic',
'trim': '(84) PASSION',
'vin': 'WME4513322K238624',
'year': 2009}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN09%2520JZF%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [bca.uk] INFO: Saving data for KN09%20JZF: {'auction_closing_time': 1774864800.0, 'created_time': 1774448151.069715, 'last_price_update_time': 1774695823.210571}
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN09%2520JZF') HTTP/1.1" 204 0
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587879%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587879 not downloaded yet
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483516%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483516 not downloaded yet
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767939%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767939 not downloaded yet
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802125%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802125 not downloaded yet
2026-03-28 11:03:43 [bca.uk] INFO: Found listing with ID: WV59%20TZE
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV59%2520TZE%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [bca.uk] INFO: Scrape type for WV59%20TZE: 1
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: da76a034-6e28-5bd7-b8f2-defa33d294f8 with identifier: WV59%20TZE
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:03:43 [bca.uk] INFO: Found listing with ID: SL12%20MFA
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL12%2520MFA%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [bca.uk] INFO: Scrape type for SL12%20MFA: 1
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4b031631-a56a-5376-a862-429861371028 with identifier: SL12%20MFA
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813884%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813884 not downloaded yet
2026-03-28 11:03:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e860c10>
2026-03-28 11:03:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_expert_report_file_c998841c-d405-41c5-a741-bf1f382cb684.pdf HTTP/1.1" 201 0
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98ba0866-113f-5795-bc05-eca7493443d3, skipping ID generation
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSD60AGX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD60AGX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602670>
2026-03-28 11:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813768>
2026-03-28 11:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602644>
2026-03-28 11:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD67%20OYC-GB>
2026-03-28 11:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587822>
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587905%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587905 not downloaded yet
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483525%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483525 not downloaded yet
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767954%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767954 not downloaded yet
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802136%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802136 not downloaded yet
2026-03-28 11:03:43 [bca.uk] INFO: Found listing with ID: OV66%20CPY
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV66%2520CPY%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [bca.uk] INFO: Scrape type for OV66%20CPY: 2
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 39021a03-228c-56b2-8e40-1291ef5bea13 with identifier: OV66%20CPY
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 39021a03-228c-56b2-8e40-1291ef5bea13 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 39021a03-228c-56b2-8e40-1291ef5bea13 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 39021a03-228c-56b2-8e40-1291ef5bea13, identifier: OV66%20CPY
2026-03-28 11:03:43 [bca.uk] INFO: Found listing with ID: WN60%20THG
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN60%2520THG%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [bca.uk] INFO: Scrape type for WN60%20THG: 2
2026-03-28 11:03:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc9aa755-7f0c-5430-b0dc-939be1b7b556 with identifier: WN60%20THG
2026-03-28 11:03:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dc9aa755-7f0c-5430-b0dc-939be1b7b556 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dc9aa755-7f0c-5430-b0dc-939be1b7b556 with scrape type 2
2026-03-28 11:03:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc9aa755-7f0c-5430-b0dc-939be1b7b556, identifier: WN60%20THG
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793121%27 HTTP/1.1" 200 None
2026-03-28 11:03:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793121 not downloaded yet
2026-03-28 11:03:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587755/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:03:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813802>
2026-03-28 11:03:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 39021a03-228c-56b2-8e40-1291ef5bea13 with identifier: OV66%20CPY
2026-03-28 11:03:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 39021a03-228c-56b2-8e40-1291ef5bea13 with identifier: OV66%20CPY
2026-03-28 11:03:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 39021a03-228c-56b2-8e40-1291ef5bea13 with identifier: OV66%20CPY to the API
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV66%20CPY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '39021a03-228c-56b2-8e40-1291ef5bea13',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV66 CPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV66%20CPY&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 138457,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 90 ENERGY Hatchback',
'transmission': 'manual',
'trim': '90 ENERGY',
'vin': 'W0L0XEP08G6062651',
'year': 2016}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV66%2520CPY%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [bca.uk] INFO: Saving data for OV66%20CPY: {'auction_closing_time': 1774778400.0, 'created_time': 1774389997.781042, 'last_price_update_time': 1774695824.070075}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV66%2520CPY') HTTP/1.1" 204 0
2026-03-28 11:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc9aa755-7f0c-5430-b0dc-939be1b7b556 with identifier: WN60%20THG
2026-03-28 11:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc9aa755-7f0c-5430-b0dc-939be1b7b556 with identifier: WN60%20THG
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc9aa755-7f0c-5430-b0dc-939be1b7b556 with identifier: WN60%20THG to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN60%20THG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc9aa755-7f0c-5430-b0dc-939be1b7b556',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN60 THG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN60%20THG&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 111803,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 ACENTA PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'ACENTA PREMIUM',
'vin': 'SJNFBAF15U6035652',
'year': 2010}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN60%2520THG%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [bca.uk] INFO: Saving data for WN60%20THG: {'auction_closing_time': 1774778400.0, 'created_time': 1774419009.694524, 'last_price_update_time': 1774695824.522674}
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN60%2520THG') HTTP/1.1" 204 0
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587930%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587930 not downloaded yet
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483535%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483535 not downloaded yet
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767975%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767975 not downloaded yet
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802150%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802150 not downloaded yet
2026-03-28 11:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602580/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:03:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:44 [bca.uk] INFO: Found listing with ID: WJ63%20NXK
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520NXK%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [bca.uk] INFO: Scrape type for WJ63%20NXK: 2
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with scrape type 2
2026-03-28 11:03:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 233b8e2a-fa40-55b8-b3af-1c1c40caef59, identifier: WJ63%20NXK
2026-03-28 11:03:44 [bca.uk] INFO: Found listing with ID: AO60%20TNJ
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO60%2520TNJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [bca.uk] INFO: Scrape type for AO60%20TNJ: 1
2026-03-28 11:03:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ
2026-03-28 11:03:44 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793126%27 HTTP/1.1" 200 None
2026-03-28 11:03:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793126 not downloaded yet
2026-03-28 11:03:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK
2026-03-28 11:03:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK
2026-03-28 11:03:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 233b8e2a-fa40-55b8-b3af-1c1c40caef59 with identifier: WJ63%20NXK to the API
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ63%20NXK-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '233b8e2a-fa40-55b8-b3af-1c1c40caef59',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ63 NXK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ63%20NXK&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 95757,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF0DXXGAKDDK81759',
'year': 2013}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ63%2520NXK%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [bca.uk] INFO: Saving data for WJ63%20NXK: {'auction_closing_time': 1774778400.0, 'created_time': 1774565248.20653, 'last_price_update_time': 1774695825.094077}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ63%2520NXK') HTTP/1.1" 204 0
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483549%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483549 not downloaded yet
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767982%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767982 not downloaded yet
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802164%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802164 not downloaded yet
2026-03-28 11:03:45 [bca.uk] INFO: Found listing with ID: EF13%20FLN
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF13%2520FLN%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [bca.uk] INFO: Scrape type for EF13%20FLN: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa with identifier: EF13%20FLN
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa, identifier: EF13%20FLN
2026-03-28 11:03:45 [bca.uk] INFO: Found listing with ID: CE12%20XPW
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE12%2520XPW%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [bca.uk] INFO: Scrape type for CE12%20XPW: 2
2026-03-28 11:03:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW
2026-03-28 11:03:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with scrape type 2
2026-03-28 11:03:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a, identifier: CE12%20XPW
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793130%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793130 not downloaded yet
2026-03-28 11:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587804/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802125>
2026-03-28 11:03:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa with identifier: EF13%20FLN
2026-03-28 11:03:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa with identifier: EF13%20FLN
2026-03-28 11:03:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa with identifier: EF13%20FLN to the API
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF13%20FLN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '68f1e3b1-1008-5fb0-b719-cb2b98f7e1fa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF13 FLN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF13%20FLN&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 88258,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM X',
'vin': 'WF0KXXGCBKDR00610',
'year': 2013}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF13%2520FLN%27 HTTP/1.1" 200 None
2026-03-28 11:03:45 [bca.uk] INFO: Saving data for EF13%20FLN: {'auction_closing_time': 1774778400.0, 'created_time': 1774448188.941756, 'last_price_update_time': 1774695825.969547}
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF13%2520FLN') HTTP/1.1" 204 0
2026-03-28 11:03:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW
2026-03-28 11:03:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW
2026-03-28 11:03:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a with identifier: CE12%20XPW to the API
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE12%20XPW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0cbf5ebe-0b4a-551b-986b-5ad8106e9e1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE12 XPW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE12%20XPW&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 84375,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 115 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'TDCI 115 ZETEC',
'vin': 'WF0KXXGCBKCR18529',
'year': 2012}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE12%2520XPW%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [bca.uk] INFO: Saving data for CE12%20XPW: {'auction_closing_time': 1774778400.0, 'created_time': 1774419013.456072, 'last_price_update_time': 1774695826.520782}
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE12%2520XPW') HTTP/1.1" 204 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483572%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483572 not downloaded yet
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768003%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768003 not downloaded yet
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802174%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802174 not downloaded yet
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd27490>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813705%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813705/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e535810>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587755%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587755/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e583a10>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813718%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813718/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e5fd0>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602580%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602580/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e85ea90>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602592%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602592/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac436050>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602567%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602567/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdb1650>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587774%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587774/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd43090>
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813739%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813739/600 saved to cache
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:03:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:03:46 [bca.uk] INFO: Found listing with ID: EO16%20KUU
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO16%2520KUU%27 HTTP/1.1" 200 None
2026-03-28 11:03:46 [bca.uk] INFO: Scrape type for EO16%20KUU: 2
2026-03-28 11:03:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ad86e2db-4636-5bc0-b960-159ba8334028 with identifier: EO16%20KUU
2026-03-28 11:03:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ad86e2db-4636-5bc0-b960-159ba8334028 with scrape type 2
2026-03-28 11:03:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ad86e2db-4636-5bc0-b960-159ba8334028 with scrape type 2
2026-03-28 11:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ad86e2db-4636-5bc0-b960-159ba8334028, identifier: EO16%20KUU
2026-03-28 11:03:47 [bca.uk] INFO: Found listing with ID: DS62%20KGV
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS62%2520KGV%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [bca.uk] INFO: Scrape type for DS62%20KGV: 0
2026-03-28 11:03:47 [bca.uk] INFO: Found listing with ID: RV57%20WUJ
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV57%2520WUJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [bca.uk] INFO: Scrape type for RV57%20WUJ: 2
2026-03-28 11:03:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8fb69217-9fd5-506e-8fca-6a5d66af8975 with identifier: RV57%20WUJ
2026-03-28 11:03:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8fb69217-9fd5-506e-8fca-6a5d66af8975 with scrape type 2
2026-03-28 11:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8fb69217-9fd5-506e-8fca-6a5d66af8975 with scrape type 2
2026-03-28 11:03:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8fb69217-9fd5-506e-8fca-6a5d66af8975, identifier: RV57%20WUJ
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793134%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793134 not downloaded yet
2026-03-28 11:03:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ad86e2db-4636-5bc0-b960-159ba8334028 with identifier: EO16%20KUU
2026-03-28 11:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ad86e2db-4636-5bc0-b960-159ba8334028 with identifier: EO16%20KUU
2026-03-28 11:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ad86e2db-4636-5bc0-b960-159ba8334028 with identifier: EO16%20KUU to the API
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 147,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO16%20KUU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ad86e2db-4636-5bc0-b960-159ba8334028',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO16 KUU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO16%20KUU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'HYUNDAI',
'model': 'TUCSON',
'odometer': 118402,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'HYUNDAI TUCSON 1.6 GDI B/D 132 2WD SE StationWagon',
'transmission': 'manual',
'trim': 'GDI B/D 132 2WD SE',
'vin': 'TMAJ3811LHJ138259',
'year': 2016}
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO16%2520KUU%27 HTTP/1.1" 200 None
2026-03-28 11:03:47 [bca.uk] INFO: Saving data for EO16%20KUU: {'auction_closing_time': 1774778400.0, 'created_time': 1774362788.439155, 'last_price_update_time': 1774695827.807436}
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO16%2520KUU') HTTP/1.1" 204 0
2026-03-28 11:03:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8fb69217-9fd5-506e-8fca-6a5d66af8975 with identifier: RV57%20WUJ
2026-03-28 11:03:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8fb69217-9fd5-506e-8fca-6a5d66af8975 with identifier: RV57%20WUJ
2026-03-28 11:03:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8fb69217-9fd5-506e-8fca-6a5d66af8975 with identifier: RV57%20WUJ to the API
2026-03-28 11:03:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RV57%20WUJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8fb69217-9fd5-506e-8fca-6a5d66af8975',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RV57 WUJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RV57%20WUJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 100501,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 ZETEC CLIMATE Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC CLIMATE',
'vin': 'WF05XXWPD57Y79692',
'year': 2007}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV57%2520WUJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [bca.uk] INFO: Saving data for RV57%20WUJ: {'auction_closing_time': 1774864800.0, 'created_time': 1774476247.78148, 'last_price_update_time': 1774695828.364988}
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RV57%2520WUJ') HTTP/1.1" 204 0
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483599%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483599 not downloaded yet
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768022%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768022 not downloaded yet
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802191%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802191 not downloaded yet
2026-03-28 11:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793121>
2026-03-28 11:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802136/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802136>
2026-03-28 11:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483525>
2026-03-28 11:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767954>
2026-03-28 11:03:48 [bca.uk] INFO: Found listing with ID: FH12%20SXS
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH12%2520SXS%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [bca.uk] INFO: Scrape type for FH12%20SXS: 2
2026-03-28 11:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS
2026-03-28 11:03:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item eb341fe8-7e6f-5054-b28c-fe932b77ca3b with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item eb341fe8-7e6f-5054-b28c-fe932b77ca3b with scrape type 2
2026-03-28 11:03:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: eb341fe8-7e6f-5054-b28c-fe932b77ca3b, identifier: FH12%20SXS
2026-03-28 11:03:48 [bca.uk] INFO: Found listing with ID: SV59%20YZL
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV59%2520YZL%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [bca.uk] INFO: Scrape type for SV59%20YZL: 0
2026-03-28 11:03:48 [bca.uk] INFO: Found listing with ID: W22%20JED
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27W22%2520JED%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [bca.uk] INFO: Scrape type for W22%20JED: 0
2026-03-28 11:03:48 [bca.uk] INFO: Found listing with ID: YR63%20WBM
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520WBM%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [bca.uk] INFO: Scrape type for YR63%20WBM: 1
2026-03-28 11:03:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 90ffee22-7433-5df0-ae47-99f4406a651d with identifier: YR63%20WBM
2026-03-28 11:03:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793141%27 HTTP/1.1" 200 None
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793141 not downloaded yet
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb81fd0>
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587822%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587822/600 saved to cache
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fffa4d0>
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587804%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587804/600 saved to cache
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e56cd90>
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813751%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813751/600 saved to cache
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce0150>
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813768%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813768/600 saved to cache
2026-03-28 11:03:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587905/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587905>
2026-03-28 11:03:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793117/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD60AGX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS
2026-03-28 11:03:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS
2026-03-28 11:03:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: eb341fe8-7e6f-5054-b28c-fe932b77ca3b with identifier: FH12%20SXS to the API
2026-03-28 11:03:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH12%20SXS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'eb341fe8-7e6f-5054-b28c-fe932b77ca3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH12 SXS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FH12%20SXS&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'AUDI',
'model': 'A6 AVANT',
'odometer': 161976,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'AUDI A6 AVANT 2.0 TDI 177 S LINE M-T Estate',
'transmission': 'manual',
'trim': 'TDI 177 S LINE M-T',
'vin': 'WAUZZZ4G1CN136795',
'year': 2012}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH12%2520SXS%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [bca.uk] INFO: Saving data for FH12%20SXS: {'auction_closing_time': 1774778400.0, 'created_time': 1774478528.11515, 'last_price_update_time': 1774695829.164479}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FH12%2520SXS') HTTP/1.1" 204 0
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483613%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483613 not downloaded yet
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768037%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768037 not downloaded yet
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802206%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802206 not downloaded yet
2026-03-28 11:03:49 [bca.uk] INFO: Found listing with ID: HK57%20YCH
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520YCH%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [bca.uk] INFO: Scrape type for HK57%20YCH: 2
2026-03-28 11:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH
2026-03-28 11:03:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 96625e0a-4e17-5a8d-96e0-92e908201f45 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 96625e0a-4e17-5a8d-96e0-92e908201f45 with scrape type 2
2026-03-28 11:03:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 96625e0a-4e17-5a8d-96e0-92e908201f45, identifier: HK57%20YCH
2026-03-28 11:03:49 [bca.uk] INFO: Found listing with ID: GN63%20YUK
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520YUK%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [bca.uk] INFO: Scrape type for GN63%20YUK: 1
2026-03-28 11:03:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b1ec82-00f3-5794-b089-4c8559efc82f with identifier: GN63%20YUK
2026-03-28 11:03:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793146%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793146 not downloaded yet
2026-03-28 11:03:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802164/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802164>
2026-03-28 11:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483549>
2026-03-28 11:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767982>
2026-03-28 11:03:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813884>
2026-03-28 11:03:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH
2026-03-28 11:03:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH
2026-03-28 11:03:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 96625e0a-4e17-5a8d-96e0-92e908201f45 with identifier: HK57%20YCH to the API
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 187,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK57%20YCH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '96625e0a-4e17-5a8d-96e0-92e908201f45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK57 YCH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK57%20YCH&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 82950,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 2.0 CRDI 138 XS StationWagon',
'transmission': 'manual',
'trim': 'CRDI 138 XS',
'vin': 'U6YJE55558L008365',
'year': 2008}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK57%2520YCH%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [bca.uk] INFO: Saving data for HK57%20YCH: {'auction_closing_time': 1774778400.0, 'created_time': 1774389980.016801, 'last_price_update_time': 1774695829.837969}
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK57%2520YCH') HTTP/1.1" 204 0
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698483628%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483628 not downloaded yet
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698768051%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768051 not downloaded yet
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802214%27 HTTP/1.1" 200 None
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802214 not downloaded yet
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42d350>
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602670%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602670/600 saved to cache
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe57bd0>
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602644%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602644/600 saved to cache
2026-03-28 11:03:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac411dd0>
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_expert_report_file_f54b114c-d4d5-4ac7-b3cb-d6440c01eef6.pdf HTTP/1.1" 201 0
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e80eee89-7e00-5fcf-8fce-b398b8e41187, skipping ID generation
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSD67OYC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD67OYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793130/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793130>
2026-03-28 11:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793126>
2026-03-28 11:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO60%20TNJ-GB>
2026-03-28 11:03:50 [bca.uk] INFO: Found listing with ID: HV64%20ZMX
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV64%2520ZMX%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [bca.uk] INFO: Scrape type for HV64%20ZMX: 1
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:03:50 [bca.uk] INFO: Found listing with ID: H9%20HBE
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27H9%2520HBE%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [bca.uk] INFO: Scrape type for H9%20HBE: 1
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c6b92bfb-395f-5a0f-be4a-ffaa99683dab with identifier: H9%20HBE
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793159%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793159 not downloaded yet
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802225%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802225 not downloaded yet
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485228%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485228 not downloaded yet
2026-03-28 11:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802136/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:50 [bca.uk] INFO: Found listing with ID: LT61%20FNW
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT61%2520FNW%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [bca.uk] INFO: Scrape type for LT61%20FNW: 0
2026-03-28 11:03:50 [bca.uk] INFO: Found listing with ID: MF58%20FJO
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF58%2520FJO%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [bca.uk] INFO: Scrape type for MF58%20FJO: 2
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef, identifier: MF58%20FJO
2026-03-28 11:03:50 [bca.uk] INFO: Found listing with ID: HF13%20ONH
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF13%2520ONH%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [bca.uk] INFO: Scrape type for HF13%20ONH: 2
2026-03-28 11:03:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b0605ad1-e424-5a46-8725-ff207683d001 with identifier: HF13%20ONH
2026-03-28 11:03:50 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b0605ad1-e424-5a46-8725-ff207683d001 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b0605ad1-e424-5a46-8725-ff207683d001 with scrape type 2
2026-03-28 11:03:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b0605ad1-e424-5a46-8725-ff207683d001, identifier: HF13%20ONH
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793167%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793167 not downloaded yet
2026-03-28 11:03:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff62290>
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813802%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813802/600 saved to cache
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac27be50>
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802125%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802125/600 saved to cache
2026-03-28 11:03:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793121/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793134/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793134>
2026-03-28 11:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:03:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO
2026-03-28 11:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO
2026-03-28 11:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f02b8286-c9c8-5403-a27c-9ebf29b8a0ef with identifier: MF58%20FJO to the API
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 153,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF58%20FJO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f02b8286-c9c8-5403-a27c-9ebf29b8a0ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF58 FJO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF58%20FJO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '320D',
'odometer': 153954,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 M SPORT Convertible',
'transmission': 'automatic',
'trim': 'M SPORT',
'vin': 'WBAWM32070E140141',
'year': 2008}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF58%2520FJO%27 HTTP/1.1" 200 None
2026-03-28 11:03:50 [bca.uk] INFO: Saving data for MF58%20FJO: {'auction_closing_time': 1774778400.0, 'created_time': 1774477972.479482, 'last_price_update_time': 1774695830.819748}
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF58%2520FJO') HTTP/1.1" 204 0
2026-03-28 11:03:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b0605ad1-e424-5a46-8725-ff207683d001 with identifier: HF13%20ONH
2026-03-28 11:03:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b0605ad1-e424-5a46-8725-ff207683d001 with identifier: HF13%20ONH
2026-03-28 11:03:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b0605ad1-e424-5a46-8725-ff207683d001 with identifier: HF13%20ONH to the API
2026-03-28 11:03:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HF13%20ONH-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b0605ad1-e424-5a46-8725-ff207683d001',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HF13 ONH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HF13%20ONH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 65561,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.6 ZETEC P/SHIFT Hatchback',
'transmission': 'automatic',
'trim': 'ZETEC P/SHIFT',
'vin': 'WF0DXXGAKDDJ15859',
'year': 2013}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF13%2520ONH%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [bca.uk] INFO: Saving data for HF13%20ONH: {'auction_closing_time': 1774864800.0, 'created_time': 1774476249.635225, 'last_price_update_time': 1774695831.256933}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HF13%2520ONH') HTTP/1.1" 204 0
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485233%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485233 not downloaded yet
2026-03-28 11:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793117/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802191>
2026-03-28 11:03:51 [bca.uk] INFO: Found listing with ID: MJ09%20GNP
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ09%2520GNP%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [bca.uk] INFO: Scrape type for MJ09%20GNP: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 070326f8-d604-5d1c-9191-1023c88bb241 with identifier: MJ09%20GNP
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 070326f8-d604-5d1c-9191-1023c88bb241 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 070326f8-d604-5d1c-9191-1023c88bb241 with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 070326f8-d604-5d1c-9191-1023c88bb241, identifier: MJ09%20GNP
2026-03-28 11:03:51 [bca.uk] INFO: Found listing with ID: KJ02%20AAA
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ02%2520AAA%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [bca.uk] INFO: Scrape type for KJ02%20AAA: 2
2026-03-28 11:03:51 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e29bc169-c6a3-546a-9a78-1d0925e9c30c with identifier: KJ02%20AAA
2026-03-28 11:03:51 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e29bc169-c6a3-546a-9a78-1d0925e9c30c with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e29bc169-c6a3-546a-9a78-1d0925e9c30c with scrape type 2
2026-03-28 11:03:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e29bc169-c6a3-546a-9a78-1d0925e9c30c, identifier: KJ02%20AAA
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698793174%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793174 not downloaded yet
2026-03-28 11:03:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587905/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 070326f8-d604-5d1c-9191-1023c88bb241 with identifier: MJ09%20GNP
2026-03-28 11:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 070326f8-d604-5d1c-9191-1023c88bb241 with identifier: MJ09%20GNP
2026-03-28 11:03:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 070326f8-d604-5d1c-9191-1023c88bb241 with identifier: MJ09%20GNP to the API
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ09%20GNP-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '070326f8-d604-5d1c-9191-1023c88bb241',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ09 GNP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ09%20GNP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'CITROEN',
'model': 'BERLINGO',
'odometer': 118395,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN BERLINGO 1.6 HDI 90 M/S XTR MPV',
'transmission': 'manual',
'trim': 'HDI 90 M/S XTR',
'vin': 'VF77J9HXC9J173765',
'year': 2009}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ09%2520GNP%27 HTTP/1.1" 200 None
2026-03-28 11:03:51 [bca.uk] INFO: Saving data for MJ09%20GNP: {'auction_closing_time': 1774778400.0, 'created_time': 1774478331.882906, 'last_price_update_time': 1774695831.964776}
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ09%2520GNP') HTTP/1.1" 204 0
2026-03-28 11:03:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e29bc169-c6a3-546a-9a78-1d0925e9c30c with identifier: KJ02%20AAA
2026-03-28 11:03:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e29bc169-c6a3-546a-9a78-1d0925e9c30c with identifier: KJ02%20AAA
2026-03-28 11:03:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e29bc169-c6a3-546a-9a78-1d0925e9c30c with identifier: KJ02%20AAA to the API
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 215,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KJ02%20AAA-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e29bc169-c6a3-546a-9a78-1d0925e9c30c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KJ02 AAA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KJ02%20AAA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'CLS 320',
'odometer': 98541,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLS 320 3.0 CDI TIP Coupe',
'transmission': 'manual',
'trim': 'CDI TIP',
'vin': 'WDD2193222A125944',
'year': 2008}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ02%2520AAA%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [bca.uk] INFO: Saving data for KJ02%20AAA: {'auction_closing_time': 1774864800.0, 'created_time': 1774476240.786368, 'last_price_update_time': 1774695832.400686}
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KJ02%2520AAA') HTTP/1.1" 204 0
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485238%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485238 not downloaded yet
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e875310>
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802136%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802136/600 saved to cache
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802164/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802206>
2026-03-28 11:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:03:52 [bca.uk] INFO: Found listing with ID: ML66%20WYO
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML66%2520WYO%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [bca.uk] INFO: Scrape type for ML66%20WYO: 2
2026-03-28 11:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffd84d52-2f10-5122-8d61-177310c6ad79 with identifier: ML66%20WYO
2026-03-28 11:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ffd84d52-2f10-5122-8d61-177310c6ad79 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ffd84d52-2f10-5122-8d61-177310c6ad79 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ffd84d52-2f10-5122-8d61-177310c6ad79, identifier: ML66%20WYO
2026-03-28 11:03:52 [bca.uk] INFO: Found listing with ID: KU07%20ERA
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU07%2520ERA%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [bca.uk] INFO: Scrape type for KU07%20ERA: 0
2026-03-28 11:03:52 [bca.uk] INFO: Found listing with ID: LT58%20VMH
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT58%2520VMH%27 HTTP/1.1" 200 None
2026-03-28 11:03:52 [bca.uk] INFO: Scrape type for LT58%20VMH: 2
2026-03-28 11:03:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 800bcf6f-1257-5836-b241-a9b5bf8477c3 with identifier: LT58%20VMH
2026-03-28 11:03:52 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 800bcf6f-1257-5836-b241-a9b5bf8477c3 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 800bcf6f-1257-5836-b241-a9b5bf8477c3 with scrape type 2
2026-03-28 11:03:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 800bcf6f-1257-5836-b241-a9b5bf8477c3, identifier: LT58%20VMH
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eabbe90>
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793121%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793121/600 saved to cache
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e413890>
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483525%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483525/600 saved to cache
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e248890>
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698767954%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767954/600 saved to cache
2026-03-28 11:03:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:03:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ffd84d52-2f10-5122-8d61-177310c6ad79 with identifier: ML66%20WYO
2026-03-28 11:03:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ffd84d52-2f10-5122-8d61-177310c6ad79 with identifier: ML66%20WYO
2026-03-28 11:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ffd84d52-2f10-5122-8d61-177310c6ad79 with identifier: ML66%20WYO to the API
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML66%20WYO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ffd84d52-2f10-5122-8d61-177310c6ad79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML66 WYO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML66%20WYO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 131936,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.5 TDCI 120 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TDCI 120 TITANIUM',
'vin': 'WF05XXGCC5GA03069',
'year': 2016}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML66%2520WYO%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [bca.uk] INFO: Saving data for ML66%20WYO: {'auction_closing_time': 1774778400.0, 'created_time': 1774565248.999568, 'last_price_update_time': 1774695833.302587}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML66%2520WYO') HTTP/1.1" 204 0
2026-03-28 11:03:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 800bcf6f-1257-5836-b241-a9b5bf8477c3 with identifier: LT58%20VMH
2026-03-28 11:03:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 800bcf6f-1257-5836-b241-a9b5bf8477c3 with identifier: LT58%20VMH
2026-03-28 11:03:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 800bcf6f-1257-5836-b241-a9b5bf8477c3 with identifier: LT58%20VMH to the API
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 184,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT58%20VMH-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '800bcf6f-1257-5836-b241-a9b5bf8477c3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT58 VMH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT58%20VMH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'X-TYPE',
'odometer': 94827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'JAGUAR X-TYPE 2.2 D SE Estate',
'transmission': 'automatic',
'trim': 'D SE',
'vin': 'SAJAG54379BJ46772',
'year': 2009}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT58%2520VMH%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [bca.uk] INFO: Saving data for LT58%20VMH: {'auction_closing_time': 1774864800.0, 'created_time': 1774044515.137342, 'last_price_update_time': 1774695833.77597}
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT58%2520VMH') HTTP/1.1" 204 0
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485246%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485246 not downloaded yet
2026-03-28 11:03:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793130/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:53 [bca.uk] INFO: Found listing with ID: ND12%20LBP
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520LBP%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [bca.uk] INFO: Scrape type for ND12%20LBP: 1
2026-03-28 11:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 325ff223-af4d-52f5-a85f-e14f2e547fe2 with identifier: ND12%20LBP
2026-03-28 11:03:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:03:53 [bca.uk] INFO: Found listing with ID: LV10%20NJJ
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV10%2520NJJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [bca.uk] INFO: Scrape type for LV10%20NJJ: 0
2026-03-28 11:03:53 [bca.uk] INFO: Found listing with ID: MC53%20GXE
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC53%2520GXE%27 HTTP/1.1" 200 None
2026-03-28 11:03:53 [bca.uk] INFO: Scrape type for MC53%20GXE: 2
2026-03-28 11:03:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9947b25a-6657-5e8d-bf39-4ed8c3d1b563 with identifier: MC53%20GXE
2026-03-28 11:03:53 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9947b25a-6657-5e8d-bf39-4ed8c3d1b563 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9947b25a-6657-5e8d-bf39-4ed8c3d1b563 with scrape type 2
2026-03-28 11:03:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9947b25a-6657-5e8d-bf39-4ed8c3d1b563, identifier: MC53%20GXE
2026-03-28 11:03:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e412990>
2026-03-28 11:03:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793117%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793117/600 saved to cache
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e6223d0>
2026-03-28 11:03:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587905%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587905/600 saved to cache
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793159>
2026-03-28 11:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802225>
2026-03-28 11:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=H9%20HBE-GB>
2026-03-28 11:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485228>
2026-03-28 11:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793134/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9947b25a-6657-5e8d-bf39-4ed8c3d1b563 with identifier: MC53%20GXE
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9947b25a-6657-5e8d-bf39-4ed8c3d1b563 with identifier: MC53%20GXE
2026-03-28 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9947b25a-6657-5e8d-bf39-4ed8c3d1b563 with identifier: MC53%20GXE to the API
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 249,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MC53%20GXE-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9947b25a-6657-5e8d-bf39-4ed8c3d1b563',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MC53 GXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MC53%20GXE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'S-TYPE',
'odometer': 88587,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'JAGUAR S-TYPE 2.5 V6 SE Saloon',
'transmission': 'automatic',
'trim': 'V6 SE',
'vin': 'SAJAC01NB4JN06683',
'year': 2004}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC53%2520GXE%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [bca.uk] INFO: Saving data for MC53%20GXE: {'auction_closing_time': 1774864800.0, 'created_time': 1774476241.670181, 'last_price_update_time': 1774695834.488206}
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MC53%2520GXE') HTTP/1.1" 204 0
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485254%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485254 not downloaded yet
2026-03-28 11:03:54 [bca.uk] INFO: Found listing with ID: CV56%20YXN
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV56%2520YXN%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [bca.uk] INFO: Scrape type for CV56%20YXN: 0
2026-03-28 11:03:54 [bca.uk] INFO: Found listing with ID: DE64%20BFP
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520BFP%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [bca.uk] INFO: Scrape type for DE64%20BFP: 2
2026-03-28 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e9aed168-e5e4-55b8-b184-6e32d4a81cc8 with identifier: DE64%20BFP
2026-03-28 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e9aed168-e5e4-55b8-b184-6e32d4a81cc8 with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e9aed168-e5e4-55b8-b184-6e32d4a81cc8 with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e9aed168-e5e4-55b8-b184-6e32d4a81cc8, identifier: DE64%20BFP
2026-03-28 11:03:54 [bca.uk] INFO: Found listing with ID: P60%20NPR
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P60%2520NPR%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [bca.uk] INFO: Scrape type for P60%20NPR: 0
2026-03-28 11:03:54 [bca.uk] INFO: Found listing with ID: AN09%20KEE
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AN09%2520KEE%27 HTTP/1.1" 200 None
2026-03-28 11:03:54 [bca.uk] INFO: Scrape type for AN09%20KEE: 2
2026-03-28 11:03:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 88980c40-93d5-541a-baab-78b80f74104a with identifier: AN09%20KEE
2026-03-28 11:03:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 88980c40-93d5-541a-baab-78b80f74104a with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 88980c40-93d5-541a-baab-78b80f74104a with scrape type 2
2026-03-28 11:03:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 88980c40-93d5-541a-baab-78b80f74104a, identifier: AN09%20KEE
2026-03-28 11:03:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793167>
2026-03-28 11:03:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e9aed168-e5e4-55b8-b184-6e32d4a81cc8 with identifier: DE64%20BFP
2026-03-28 11:03:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e9aed168-e5e4-55b8-b184-6e32d4a81cc8 with identifier: DE64%20BFP
2026-03-28 11:03:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e9aed168-e5e4-55b8-b184-6e32d4a81cc8 with identifier: DE64%20BFP to the API
2026-03-28 11:03:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=5&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DE64%20BFP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e9aed168-e5e4-55b8-b184-6e32d4a81cc8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DE64 BFP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DE64%20BFP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MERCEDES-BENZ',
'model': 'C220',
'odometer': 146109,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C220 2.1 B/T SPORT Estate',
'transmission': 'manual',
'trim': 'B/T SPORT',
'vin': 'WDD2052042F070980',
'year': 2014}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520BFP%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [bca.uk] INFO: Saving data for DE64%20BFP: {'auction_closing_time': 1774778400.0, 'created_time': 1774448187.665246, 'last_price_update_time': 1774695835.18729}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DE64%2520BFP') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 88980c40-93d5-541a-baab-78b80f74104a with identifier: AN09%20KEE
2026-03-28 11:03:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 88980c40-93d5-541a-baab-78b80f74104a with identifier: AN09%20KEE
2026-03-28 11:03:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 88980c40-93d5-541a-baab-78b80f74104a with identifier: AN09%20KEE to the API
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AN09%20KEE-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '88980c40-93d5-541a-baab-78b80f74104a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AN09 KEE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AN09%20KEE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KUGA',
'odometer': 89812,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM P/SHIFT StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM P/SHIFT',
'vin': 'WF0RXXGCDRBJ12291',
'year': 2012}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AN09%2520KEE%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [bca.uk] INFO: Saving data for AN09%20KEE: {'auction_closing_time': 1774864800.0, 'created_time': 1774591785.829114, 'last_price_update_time': 1774695835.547226}
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AN09%2520KEE') HTTP/1.1" 204 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485269%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485269 not downloaded yet
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4d490>
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802164%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802164/600 saved to cache
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcd53d0>
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698767982%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767982/600 saved to cache
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3f1d0>
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483549%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483549/600 saved to cache
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:03:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e249b90>
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813884%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813884/600 saved to cache
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fda4850>
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793126%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793126/600 saved to cache
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e24a4d0>
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793130%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793130/600 saved to cache
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV64%20ZMX-GB>
2026-03-28 11:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485233>
2026-03-28 11:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD67OYC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793174>
2026-03-28 11:03:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:55 [bca.uk] INFO: Found listing with ID: BV13%20ZYW
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV13%2520ZYW%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [bca.uk] INFO: Scrape type for BV13%20ZYW: 0
2026-03-28 11:03:55 [bca.uk] INFO: Found listing with ID: BF08%20KPJ
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KPJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:55 [bca.uk] INFO: Scrape type for BF08%20KPJ: 2
2026-03-28 11:03:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ
2026-03-28 11:03:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 662cd44a-a464-53d8-b993-52f201f9f030 with scrape type 2
2026-03-28 11:03:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 662cd44a-a464-53d8-b993-52f201f9f030 with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 662cd44a-a464-53d8-b993-52f201f9f030, identifier: BF08%20KPJ
2026-03-28 11:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ
2026-03-28 11:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ
2026-03-28 11:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 662cd44a-a464-53d8-b993-52f201f9f030 with identifier: BF08%20KPJ to the API
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 221,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF08%20KPJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '662cd44a-a464-53d8-b993-52f201f9f030',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF08 KPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF08%20KPJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CHRYSLER',
'model': 'GRAND VOYAGER',
'odometer': 90396,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'CHRYSLER GRAND VOYAGER 2.8 CRD EXECUTIVE MPV',
'transmission': 'automatic',
'trim': 'CRD EXECUTIVE',
'vin': '1A8GHB3567Y575900',
'year': 2008}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520KPJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [bca.uk] INFO: Saving data for BF08%20KPJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774591785.471429, 'last_price_update_time': 1774695836.401674}
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF08%2520KPJ') HTTP/1.1" 204 0
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485280%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485280 not downloaded yet
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdd48d0>
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793134%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793134/600 saved to cache
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802214>
2026-03-28 11:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485238>
2026-03-28 11:03:56 [bca.uk] INFO: Found listing with ID: BJ07%20JAO
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520JAO%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [bca.uk] INFO: Scrape type for BJ07%20JAO: 2
2026-03-28 11:03:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87b0971e-2117-5ca5-9f70-49b1d394030b with identifier: BJ07%20JAO
2026-03-28 11:03:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87b0971e-2117-5ca5-9f70-49b1d394030b with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87b0971e-2117-5ca5-9f70-49b1d394030b with scrape type 2
2026-03-28 11:03:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87b0971e-2117-5ca5-9f70-49b1d394030b, identifier: BJ07%20JAO
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e256e10>
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_expert_report_file_3648d731-5738-4165-a6c7-4a5c3bb1698c.pdf HTTP/1.1" 201 0
2026-03-28 11:03:56 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:03:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46ca9b47-7e63-553f-bf45-5039f76f4c7d, skipping ID generation
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAO60TNJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO60TNJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768051/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768051>
2026-03-28 11:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87b0971e-2117-5ca5-9f70-49b1d394030b with identifier: BJ07%20JAO
2026-03-28 11:03:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87b0971e-2117-5ca5-9f70-49b1d394030b with identifier: BJ07%20JAO
2026-03-28 11:03:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87b0971e-2117-5ca5-9f70-49b1d394030b with identifier: BJ07%20JAO to the API
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 259,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ07%20JAO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87b0971e-2117-5ca5-9f70-49b1d394030b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ07 JAO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ07%20JAO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'S-TYPE',
'odometer': 94230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'JAGUAR S-TYPE 3.0 V6 XS Saloon',
'transmission': 'automatic',
'trim': 'V6 XS',
'vin': 'SAJAC02M46FN66438',
'year': 2007}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520JAO%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Saving data for BJ07%20JAO: {'auction_closing_time': 1774778400.0, 'created_time': 1774044505.378678, 'last_price_update_time': 1774695837.017325}
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ07%2520JAO') HTTP/1.1" 204 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485293%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485293 not downloaded yet
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e6190>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802191%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802191/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485246/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485246>
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: GJ58%20HSC
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ58%2520HSC%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for GJ58%20HSC: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775729%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775729 not downloaded yet
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff60050>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802206%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802206/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485254>
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698485300%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485300 not downloaded yet
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: GK61%20NMX
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for GK61%20NMX: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775736%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775736 not downloaded yet
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eba90d0>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485228%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485228/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eba9590>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802225%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802225/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND12%20LBP-GB>
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: LG08%20RMU
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG08%2520RMU%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for LG08%20RMU: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 93ba7a6a-2703-5b61-8fe2-d2f537296d23 with identifier: LG08%20RMU
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775751%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775751 not downloaded yet
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad18de90>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793159%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793159/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea797d0>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485233%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485233/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8746d0>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485221%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485221/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2c990>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793167%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793167/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485269>
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: LL61%20ZWT
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL61%2520ZWT%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for LL61%20ZWT: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 37d571a3-cd69-5f7b-9025-adff3b75dcf8 with identifier: LL61%20ZWT
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775771%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775771 not downloaded yet
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485280>
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768051/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: MF51%20EOS
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF51%2520EOS%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for MF51%20EOS: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14052306-8add-5dde-a7d4-036fc08c64dc with identifier: MF51%20EOS
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775786%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775786 not downloaded yet
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea8a9d0>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793174%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793174/600 saved to cache
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe187d0>
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_expert_report_file_cb9337f3-aa2b-4e61-b6c2-1c6c82667e1c.pdf HTTP/1.1" 201 0
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6b92bfb-395f-5a0f-be4a-ffaa99683dab, skipping ID generation
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DH9HBE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=H9HBE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485246/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483628>
2026-03-28 11:03:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AO60TNJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: VK16%20BTV
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for VK16%20BTV: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775821%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775821 not downloaded yet
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681955%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681955 not downloaded yet
2026-03-28 11:03:57 [bca.uk] INFO: Found listing with ID: RX18%20LZV
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX18%2520LZV%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [bca.uk] INFO: Scrape type for RX18%20LZV: 1
2026-03-28 11:03:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc with identifier: RX18%20LZV
2026-03-28 11:03:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775852%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775852 not downloaded yet
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681967%27 HTTP/1.1" 200 None
2026-03-28 11:03:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681967 not downloaded yet
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfa990>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_expert_report_file_2ce0624e-92e8-4a1b-a6cd-3d083a2a77bf.pdf HTTP/1.1" 201 0
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41bf9816-8fd1-5167-9917-2be2811cb13e, skipping ID generation
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHV64ZMX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV64ZMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb0dd0>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485238%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485238/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42cc10>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802214%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802214/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb26390>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698768051%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768051/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485300>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775729>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ58%20HSC-GB>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698485293>
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775736>
2026-03-28 11:03:58 [bca.uk] INFO: Found listing with ID: GR21%20HBF
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR21%2520HBF%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [bca.uk] INFO: Scrape type for GR21%20HBF: 1
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24623035-d9ac-5881-a02b-df41247ee5f0 with identifier: GR21%20HBF
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775894%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775894 not downloaded yet
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681989%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681989 not downloaded yet
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197721%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197721 not downloaded yet
2026-03-28 11:03:58 [bca.uk] INFO: Found listing with ID: DX70%20UBS
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX70%2520UBS%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [bca.uk] INFO: Scrape type for DX70%20UBS: 1
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e5a2781a-bf30-515d-96de-139303c8d44d with identifier: DX70%20UBS
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775923%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775923 not downloaded yet
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682012%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682012 not downloaded yet
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e844f10>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485246%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485246/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197724%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197724 not downloaded yet
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775771>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG08%20RMU-GB>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL61%20ZWT-GB>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775751/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775751>
2026-03-28 11:03:58 [bca.uk] INFO: Found listing with ID: EU19%20RWF
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU19%2520RWF%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [bca.uk] INFO: Scrape type for EU19%20RWF: 1
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d110be31-ad93-5365-9ead-c1775f8e8e2b with identifier: EU19%20RWF
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682030%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682030 not downloaded yet
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197728%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197728 not downloaded yet
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb048d0>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485254%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485254/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea76ed0>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485269%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485269/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:58 [bca.uk] INFO: Found listing with ID: FD18%20CVW
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520CVW%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [bca.uk] INFO: Scrape type for FD18%20CVW: 1
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ff90612e-f16f-5f6b-a6b0-98d7117c35f6 with identifier: FD18%20CVW
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682091%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682091 not downloaded yet
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=H9HBE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197731%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197731 not downloaded yet
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:03:58 [bca.uk] INFO: Found listing with ID: FL20%20CPY
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520CPY%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [bca.uk] INFO: Scrape type for FL20%20CPY: 1
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c55db6a9-0058-5b15-9854-0020af84912b with identifier: FL20%20CPY
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682120%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682120 not downloaded yet
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24bc50>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_expert_report_file_fb0df974-a6b6-4d45-99b4-62f0c8df68d5.pdf HTTP/1.1" 201 0
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 325ff223-af4d-52f5-a85f-e14f2e547fe2, skipping ID generation
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DND12LBP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND12LBP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac278550>
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775726%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775726/600 saved to cache
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197737%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197737 not downloaded yet
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681967/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681967>
2026-03-28 11:03:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681989>
2026-03-28 11:03:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485293/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:58 [bca.uk] INFO: Found listing with ID: HY06%20NAU
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520NAU%27 HTTP/1.1" 200 None
2026-03-28 11:03:58 [bca.uk] INFO: Scrape type for HY06%20NAU: 2
2026-03-28 11:03:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1f1348d-8628-5748-9629-8311bec532d5 with identifier: HY06%20NAU
2026-03-28 11:03:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1f1348d-8628-5748-9629-8311bec532d5 with scrape type 2
2026-03-28 11:03:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1f1348d-8628-5748-9629-8311bec532d5 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d1f1348d-8628-5748-9629-8311bec532d5, identifier: HY06%20NAU
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682151%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682151 not downloaded yet
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473628%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473628 not downloaded yet
2026-03-28 11:03:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:03:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:03:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:03:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:03:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c2850>
2026-03-28 11:03:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:03:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485280%252F600') HTTP/1.1" 204 0
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485280/600 saved to cache
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD67OYC/42800674?sv=2020-08-04&st=2026-03-28T11%3A03%3A42Z&se=2026-03-28T11%3A28%3A42Z&sr=b&sp=r&sig=x2lfg7IC%2F%2Fr5bjxlPnMww7AMhrks6l95cdksmQtmbow%3D)
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d1f1348d-8628-5748-9629-8311bec532d5 with identifier: HY06%20NAU
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d1f1348d-8628-5748-9629-8311bec532d5 with identifier: HY06%20NAU
2026-03-28 11:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d1f1348d-8628-5748-9629-8311bec532d5 with identifier: HY06%20NAU to the API
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:03:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HY06%20NAU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd1f1348d-8628-5748-9629-8311bec532d5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HY06 NAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HY06%20NAU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 128645,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.8 DESIGN Estate',
'transmission': 'automatic',
'trim': 'DESIGN',
'vin': 'W0L0AHL3562105672',
'year': 2006}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY06%2520NAU%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [bca.uk] INFO: Saving data for HY06%20NAU: {'auction_closing_time': 1774951200.0, 'created_time': 1774361633.473657, 'last_price_update_time': 1774695839.523809}
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HY06%2520NAU') HTTP/1.1" 204 0
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197744%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197744 not downloaded yet
2026-03-28 11:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197721/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197721>
2026-03-28 11:03:59 [bca.uk] INFO: Found listing with ID: LM17%20JWJ
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520JWJ%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [bca.uk] INFO: Scrape type for LM17%20JWJ: 2
2026-03-28 11:03:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d1a7686d-f737-5948-8d5f-910484c2f754 with identifier: LM17%20JWJ
2026-03-28 11:03:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d1a7686d-f737-5948-8d5f-910484c2f754 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d1a7686d-f737-5948-8d5f-910484c2f754 with scrape type 2
2026-03-28 11:03:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d1a7686d-f737-5948-8d5f-910484c2f754, identifier: LM17%20JWJ
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682183%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682183 not downloaded yet
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473636%27 HTTP/1.1" 200 None
2026-03-28 11:03:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473636 not downloaded yet
2026-03-28 11:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:03:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775751/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:03:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197724>
2026-03-28 11:03:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d1a7686d-f737-5948-8d5f-910484c2f754 with identifier: LM17%20JWJ
2026-03-28 11:03:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d1a7686d-f737-5948-8d5f-910484c2f754 with identifier: LM17%20JWJ
2026-03-28 11:03:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d1a7686d-f737-5948-8d5f-910484c2f754 with identifier: LM17%20JWJ to the API
2026-03-28 11:03:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM17%20JWJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd1a7686d-f737-5948-8d5f-910484c2f754',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LM17 JWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM17%20JWJ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'A200 D',
'odometer': 79357,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 D 2.1 AMG LINE PREMIUM PLUS DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM PLUS DCT',
'vin': 'WDD1760082V190651',
'year': 2017}
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM17%2520JWJ%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [bca.uk] INFO: Saving data for LM17%20JWJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774448581.940906, 'last_price_update_time': 1774695840.35349}
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM17%2520JWJ') HTTP/1.1" 204 0
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197750%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197750 not downloaded yet
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf4bd0>
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483628%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483628/600 saved to cache
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea25410>
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775736%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775736/600 saved to cache
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebac310>
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775729%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775729/600 saved to cache
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6c690>
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485293%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485293/600 saved to cache
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:04:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682012>
2026-03-28 11:04:00 [bca.uk] INFO: Found listing with ID: LX17%20OGL
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX17%2520OGL%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [bca.uk] INFO: Scrape type for LX17%20OGL: 2
2026-03-28 11:04:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a0a57a0a-7a5c-5c63-87ca-79740ef1f19f with identifier: LX17%20OGL
2026-03-28 11:04:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a0a57a0a-7a5c-5c63-87ca-79740ef1f19f with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a0a57a0a-7a5c-5c63-87ca-79740ef1f19f with scrape type 2
2026-03-28 11:04:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a0a57a0a-7a5c-5c63-87ca-79740ef1f19f, identifier: LX17%20OGL
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473644%27 HTTP/1.1" 200 None
2026-03-28 11:04:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473644 not downloaded yet
2026-03-28 11:04:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a0a57a0a-7a5c-5c63-87ca-79740ef1f19f with identifier: LX17%20OGL
2026-03-28 11:04:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a0a57a0a-7a5c-5c63-87ca-79740ef1f19f with identifier: LX17%20OGL
2026-03-28 11:04:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a0a57a0a-7a5c-5c63-87ca-79740ef1f19f with identifier: LX17%20OGL to the API
2026-03-28 11:04:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX17%20OGL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a0a57a0a-7a5c-5c63-87ca-79740ef1f19f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX17 OGL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX17%20OGL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 64969,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 TD4 180 4WD HSE DYNAMIC Hatchback',
'transmission': 'automatic',
'trim': 'TD4 180 4WD HSE DYNAMIC',
'vin': 'SALVA2AN0HH229521',
'year': 2017}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX17%2520OGL%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [bca.uk] INFO: Saving data for LX17%20OGL: {'auction_closing_time': 1774951200.0, 'created_time': 1774448565.034845, 'last_price_update_time': 1774695841.581798}
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX17%2520OGL') HTTP/1.1" 204 0
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197762%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197762 not downloaded yet
2026-03-28 11:04:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaee050>
2026-03-28 11:04:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD67OYC%252F698485300%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485300/600 saved to cache
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e80eee89-7e00-5fcf-8fce-b398b8e41187
2026-03-28 11:04:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e80eee89-7e00-5fcf-8fce-b398b8e41187, skipping ID generation
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e80eee89-7e00-5fcf-8fce-b398b8e41187 sending to next pipeline
2026-03-28 11:04:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e80eee89-7e00-5fcf-8fce-b398b8e41187, identifier: SD67%20OYC
2026-03-28 11:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681967/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682091/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682091>
2026-03-28 11:04:01 [bca.uk] INFO: Found listing with ID: RK16%20MEU
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK16%2520MEU%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [bca.uk] INFO: Scrape type for RK16%20MEU: 1
2026-03-28 11:04:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf083331-75bf-55d8-91b4-b55d09b57bc3 with identifier: RK16%20MEU
2026-03-28 11:04:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473647%27 HTTP/1.1" 200 None
2026-03-28 11:04:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473647 not downloaded yet
2026-03-28 11:04:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e80eee89-7e00-5fcf-8fce-b398b8e41187 with identifier: SD67%20OYC
2026-03-28 11:04:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e80eee89-7e00-5fcf-8fce-b398b8e41187 with identifier: SD67%20OYC
2026-03-28 11:04:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e80eee89-7e00-5fcf-8fce-b398b8e41187 with identifier: SD67%20OYC to the API
2026-03-28 11:04:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485300/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_expert_report_file_f54b114c-d4d5-4ac7-b3cb-d6440c01eef6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD67%20OYC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e80eee89-7e00-5fcf-8fce-b398b8e41187',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD67 OYC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD67%20OYC&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 69597,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46023,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485246/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93854,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485293/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e80eee89-7e00-5fcf-8fce-b398b8e41187/e80eee89-7e00-5fcf-8fce-b398b8e41187_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87021,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD67OYC/698485300/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 60 MATCH EDITION Hatchback',
'transmission': 'manual',
'trim': '60 MATCH EDITION',
'vin': 'WVWZZZ6RZHU083914',
'year': 2017}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD67%2520OYC%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [bca.uk] INFO: Saving data for SD67%20OYC: {'created_time': 1774695842.213734, 'last_price_update_time': 1774695842.213745, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD67%2520OYC') HTTP/1.1" 204 0
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcdbb50>
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775771%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775771/600 saved to cache
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffaab90>
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775751%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775751/600 saved to cache
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ND12LBP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698197768%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197768 not downloaded yet
2026-03-28 11:04:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682120/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682120>
2026-03-28 11:04:02 [bca.uk] INFO: Found listing with ID: WL54%20NHF
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL54%2520NHF%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [bca.uk] INFO: Scrape type for WL54%20NHF: 2
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 221c969f-6e38-587b-9f29-a72ac1bd8380 with identifier: WL54%20NHF
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 221c969f-6e38-587b-9f29-a72ac1bd8380 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 221c969f-6e38-587b-9f29-a72ac1bd8380 with scrape type 2
2026-03-28 11:04:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 221c969f-6e38-587b-9f29-a72ac1bd8380, identifier: WL54%20NHF
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473651%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473651 not downloaded yet
2026-03-28 11:04:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 221c969f-6e38-587b-9f29-a72ac1bd8380 with identifier: WL54%20NHF
2026-03-28 11:04:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 221c969f-6e38-587b-9f29-a72ac1bd8380 with identifier: WL54%20NHF
2026-03-28 11:04:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 221c969f-6e38-587b-9f29-a72ac1bd8380 with identifier: WL54%20NHF to the API
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WL54%20NHF-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '221c969f-6e38-587b-9f29-a72ac1bd8380',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WL54 NHF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WL54%20NHF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'TRANSIT 350',
'odometer': 96986,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'FORD TRANSIT 350 2.4 TDI 115 LWB M/R PanelVan',
'transmission': 'manual',
'trim': 'TDI 115 LWB M/R',
'vin': 'WF0LXXTTFL4S72463',
'year': 2005}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WL54%2520NHF%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [bca.uk] INFO: Saving data for WL54%20NHF: {'auction_closing_time': 1774951200.0, 'created_time': 1774363313.596005, 'last_price_update_time': 1774695842.851537}
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WL54%2520NHF') HTTP/1.1" 204 0
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb2190>
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_expert_report_file_3c3ee5bb-a8d3-4ad4-b266-d05993d04838.pdf HTTP/1.1" 201 0
2026-03-28 11:04:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7, skipping ID generation
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGJ58HSC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ58HSC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e56d790>
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698681989%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681989/600 saved to cache
2026-03-28 11:04:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feff9d0>
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698681938%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681938/600 saved to cache
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e29a610>
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698681967%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681967/600 saved to cache
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197737>
2026-03-28 11:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL20%20CPY-GB>
2026-03-28 11:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197744/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197744>
2026-03-28 11:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197721/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:03 [bca.uk] INFO: Found listing with ID: WR11%20HHA
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR11%2520HHA%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [bca.uk] INFO: Scrape type for WR11%20HHA: 2
2026-03-28 11:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d8d2c257-57a4-5980-998a-9bdddde806b1 with identifier: WR11%20HHA
2026-03-28 11:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d8d2c257-57a4-5980-998a-9bdddde806b1 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d8d2c257-57a4-5980-998a-9bdddde806b1 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d8d2c257-57a4-5980-998a-9bdddde806b1, identifier: WR11%20HHA
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473656%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473656 not downloaded yet
2026-03-28 11:04:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d8d2c257-57a4-5980-998a-9bdddde806b1 with identifier: WR11%20HHA
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=beige HTTP/1.1" 200 None
2026-03-28 11:04:03 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:04:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d8d2c257-57a4-5980-998a-9bdddde806b1 with identifier: WR11%20HHA
2026-03-28 11:04:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d8d2c257-57a4-5980-998a-9bdddde806b1 with identifier: WR11%20HHA to the API
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WR11%20HHA-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd8d2c257-57a4-5980-998a-9bdddde806b1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WR11 HHA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WR11%20HHA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C4',
'odometer': 97902,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CITROEN C4 1.6 E-HDI 110 VTR+ EGS Hatchback',
'transmission': 'automatic',
'trim': 'E-HDI 110 VTR+ EGS',
'vin': 'VF7NC9HR8AY579828',
'year': 2011}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR11%2520HHA%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [bca.uk] INFO: Saving data for WR11%20HHA: {'auction_closing_time': 1774951200.0, 'created_time': 1774363309.817868, 'last_price_update_time': 1774695843.790461}
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WR11%2520HHA') HTTP/1.1" 204 0
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463065%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463065 not downloaded yet
2026-03-28 11:04:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473628/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473628>
2026-03-28 11:04:03 [bca.uk] INFO: Found listing with ID: YL17%20SVO
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520SVO%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [bca.uk] INFO: Scrape type for YL17%20SVO: 2
2026-03-28 11:04:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6de2bce6-3d1e-5957-a636-f6b2fea49565 with identifier: YL17%20SVO
2026-03-28 11:04:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6de2bce6-3d1e-5957-a636-f6b2fea49565 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6de2bce6-3d1e-5957-a636-f6b2fea49565 with scrape type 2
2026-03-28 11:04:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6de2bce6-3d1e-5957-a636-f6b2fea49565, identifier: YL17%20SVO
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473659%27 HTTP/1.1" 200 None
2026-03-28 11:04:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473659 not downloaded yet
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb76c10>
2026-03-28 11:04:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_expert_report_file_63ffa086-ef41-46ac-8588-4e163d93beba.pdf HTTP/1.1" 201 0
2026-03-28 11:04:04 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93ba7a6a-2703-5b61-8fe2-d2f537296d23, skipping ID generation
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLG08RMU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG08RMU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682183/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682183>
2026-03-28 11:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197750>
2026-03-28 11:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473644>
2026-03-28 11:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473636>
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6de2bce6-3d1e-5957-a636-f6b2fea49565 with identifier: YL17%20SVO
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6de2bce6-3d1e-5957-a636-f6b2fea49565 with identifier: YL17%20SVO
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6de2bce6-3d1e-5957-a636-f6b2fea49565 with identifier: YL17%20SVO to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 299,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL17%20SVO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '5.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6de2bce6-3d1e-5957-a636-f6b2fea49565',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YL17 SVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YL17%20SVO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'RANGE ROVER',
'odometer': 109099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER RANGE ROVER 5.0 S/C SVAUTOBIOGRAPHY DYNAMIC StationWagon',
'transmission': 'manual',
'trim': 'S/C SVAUTOBIOGRAPHY DYNAMIC',
'vin': 'SALGA2EE9HA345747',
'year': 2017}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520SVO%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [bca.uk] INFO: Saving data for YL17%20SVO: {'auction_closing_time': 1774951200.0, 'created_time': 1774448558.74288, 'last_price_update_time': 1774695844.600386}
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YL17%2520SVO') HTTP/1.1" 204 0
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463067%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463067 not downloaded yet
2026-03-28 11:04:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682091/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:04 [bca.uk] INFO: Found listing with ID: HG09%20ZSN
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG09%2520ZSN%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [bca.uk] INFO: Scrape type for HG09%20ZSN: 2
2026-03-28 11:04:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 128d4936-d884-588c-8b66-1bc951ca8bfa with identifier: HG09%20ZSN
2026-03-28 11:04:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 128d4936-d884-588c-8b66-1bc951ca8bfa with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 128d4936-d884-588c-8b66-1bc951ca8bfa with scrape type 2
2026-03-28 11:04:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 128d4936-d884-588c-8b66-1bc951ca8bfa, identifier: HG09%20ZSN
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473663%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473663 not downloaded yet
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717121%27 HTTP/1.1" 200 None
2026-03-28 11:04:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717121 not downloaded yet
2026-03-28 11:04:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197768>
2026-03-28 11:04:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 128d4936-d884-588c-8b66-1bc951ca8bfa with identifier: HG09%20ZSN
2026-03-28 11:04:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 128d4936-d884-588c-8b66-1bc951ca8bfa with identifier: HG09%20ZSN
2026-03-28 11:04:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 128d4936-d884-588c-8b66-1bc951ca8bfa with identifier: HG09%20ZSN to the API
2026-03-28 11:04:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG09%20ZSN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '128d4936-d884-588c-8b66-1bc951ca8bfa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG09 ZSN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HG09%20ZSN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'CIVIC',
'odometer': 125262,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HONDA CIVIC 1.4 I-VTEC TYPE S Hatchback',
'transmission': 'manual',
'trim': 'I-VTEC TYPE S',
'vin': 'SHHFN43409U001736',
'year': 2009}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG09%2520ZSN%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [bca.uk] INFO: Saving data for HG09%20ZSN: {'auction_closing_time': 1774951200.0, 'created_time': 1774363364.151308, 'last_price_update_time': 1774695845.199779}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HG09%2520ZSN') HTTP/1.1" 204 0
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463070%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463070 not downloaded yet
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9ef9d0>
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_expert_report_file_9e077f53-a841-4d91-9b7a-7c6a64e675d3.pdf HTTP/1.1" 201 0
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d571a3-cd69-5f7b-9025-adff3b75dcf8, skipping ID generation
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLL61ZWT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LL61ZWT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2c710>
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197724%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197724/600 saved to cache
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e257a90>
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197721%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197721/600 saved to cache
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97e810>
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698682012%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682012/600 saved to cache
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473647/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473647>
2026-03-28 11:04:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473651/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473651>
2026-03-28 11:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682120/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:05 [bca.uk] INFO: Found listing with ID: HV15%20LXE
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV15%2520LXE%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [bca.uk] INFO: Scrape type for HV15%20LXE: 2
2026-03-28 11:04:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45dab056-3701-549b-b453-3f1f39a50142 with identifier: HV15%20LXE
2026-03-28 11:04:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45dab056-3701-549b-b453-3f1f39a50142 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45dab056-3701-549b-b453-3f1f39a50142 with scrape type 2
2026-03-28 11:04:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45dab056-3701-549b-b453-3f1f39a50142, identifier: HV15%20LXE
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698473670%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473670 not downloaded yet
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717144%27 HTTP/1.1" 200 None
2026-03-28 11:04:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717144 not downloaded yet
2026-03-28 11:04:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197744/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45dab056-3701-549b-b453-3f1f39a50142 with identifier: HV15%20LXE
2026-03-28 11:04:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45dab056-3701-549b-b453-3f1f39a50142 with identifier: HV15%20LXE
2026-03-28 11:04:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45dab056-3701-549b-b453-3f1f39a50142 with identifier: HV15%20LXE to the API
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV15%20LXE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '45dab056-3701-549b-b453-3f1f39a50142',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV15 LXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV15%20LXE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FIAT',
'model': '500C',
'odometer': 47810,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500C 1.2 LOUNGE S/S Convertible',
'transmission': 'automatic',
'trim': 'LOUNGE S/S',
'vin': 'ZFA3120000J301957',
'year': 2015}
2026-03-28 11:04:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV15%2520LXE%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [bca.uk] INFO: Saving data for HV15%20LXE: {'auction_closing_time': 1774778400.0, 'created_time': 1774592196.498309, 'last_price_update_time': 1774695846.002862}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV15%2520LXE') HTTP/1.1" 204 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463073%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463073 not downloaded yet
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948220%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948220 not downloaded yet
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea78890>
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473621%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473621/600 saved to cache
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e845150>
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698682091%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682091/600 saved to cache
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK16%20MEU-GB>
2026-03-28 11:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473628/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:06 [bca.uk] INFO: Found listing with ID: HY57%20KMG
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY57%2520KMG%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [bca.uk] INFO: Scrape type for HY57%20KMG: 0
2026-03-28 11:04:06 [bca.uk] INFO: Found listing with ID: PN17%20YAG
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN17%2520YAG%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [bca.uk] INFO: Scrape type for PN17%20YAG: 1
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 94f53ba1-1a48-56f6-af9c-addac3acf253 with identifier: PN17%20YAG
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717177%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717177 not downloaded yet
2026-03-28 11:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463081%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463081 not downloaded yet
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948224%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948224 not downloaded yet
2026-03-28 11:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:06 [bca.uk] INFO: Found listing with ID: VE67%20VVT
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE67%2520VVT%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [bca.uk] INFO: Scrape type for VE67%20VVT: 2
2026-03-28 11:04:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b1fd78c1-3bc4-503d-9329-f3576638831b with identifier: VE67%20VVT
2026-03-28 11:04:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b1fd78c1-3bc4-503d-9329-f3576638831b with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b1fd78c1-3bc4-503d-9329-f3576638831b with scrape type 2
2026-03-28 11:04:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b1fd78c1-3bc4-503d-9329-f3576638831b, identifier: VE67%20VVT
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717203%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717203 not downloaded yet
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea62a50>
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197737%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197737/600 saved to cache
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe57390>
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698682120%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682120/600 saved to cache
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc98e10>
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197744%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197744/600 saved to cache
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473656>
2026-03-28 11:04:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b1fd78c1-3bc4-503d-9329-f3576638831b with identifier: VE67%20VVT
2026-03-28 11:04:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b1fd78c1-3bc4-503d-9329-f3576638831b with identifier: VE67%20VVT
2026-03-28 11:04:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b1fd78c1-3bc4-503d-9329-f3576638831b with identifier: VE67%20VVT to the API
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VE67%20VVT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b1fd78c1-3bc4-503d-9329-f3576638831b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VE67 VVT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VE67%20VVT&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'ONE',
'odometer': 38073,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MINI ONE 1.2 102 Hatchback',
'transmission': 'manual',
'trim': '102',
'vin': 'WMWXN720002G40476',
'year': 2017}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE67%2520VVT%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [bca.uk] INFO: Saving data for VE67%20VVT: {'auction_closing_time': 1774778400.0, 'created_time': 1774592194.051292, 'last_price_update_time': 1774695846.832282}
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VE67%2520VVT') HTTP/1.1" 204 0
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463088%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463088 not downloaded yet
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948226%27 HTTP/1.1" 200 None
2026-03-28 11:04:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948226 not downloaded yet
2026-03-28 11:04:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463065>
2026-03-28 11:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682183/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:06 [bca.uk] INFO: Found listing with ID: YB65%20ELU
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB65%2520ELU%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for YB65%20ELU: 1
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 41bfed47-06be-532e-8f54-e5c676d90605 with identifier: YB65%20ELU
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717226%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717226 not downloaded yet
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473647/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463067>
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473651/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463093%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463093 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948228%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948228 not downloaded yet
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb59290>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473628%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473628/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d9310>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_expert_report_file_f083dfa8-79bc-4a86-b947-74855bd52595.pdf HTTP/1.1" 201 0
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c55db6a9-0058-5b15-9854-0020af84912b, skipping ID generation
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFL20CPY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL20CPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd11610>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473644%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473644/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae782790>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473636%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473636/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:07 [bca.uk] INFO: Found listing with ID: DN64%20GYD
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN64%2520GYD%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for DN64%20GYD: 0
2026-03-28 11:04:07 [bca.uk] INFO: Found listing with ID: GU62%20NWF
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520NWF%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for GU62%20NWF: 1
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a14b43-8d32-5a4d-ac93-9ace42126b1a with identifier: GU62%20NWF
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717258%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717258 not downloaded yet
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948217/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LL61ZWT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463104%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463104 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948231%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948231 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993042%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993042 not downloaded yet
2026-03-28 11:04:07 [bca.uk] INFO: Found listing with ID: HF57%20DZO
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF57%2520DZO%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for HF57%20DZO: 1
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f41977d4-aa4c-5c65-a9f6-75359a06d1d3 with identifier: HF57%20DZO
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717281%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717281 not downloaded yet
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe2b250>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698682183%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682183/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe99bd0>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197750%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197750/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3d310>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473647%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473647/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3eb90>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473651%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473651/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffeb190>
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197768%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197768/600 saved to cache
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717144>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717121/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717121>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463070>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717177>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948220/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948220>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN17%20YAG-GB>
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697463111%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463111 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948234%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948234 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993057%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993057 not downloaded yet
2026-03-28 11:04:07 [bca.uk] INFO: Found listing with ID: GL09%20EWC
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL09%2520EWC%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for GL09%20EWC: 1
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: acf5b92b-bb35-5c57-bbff-c8eb713ecc47 with identifier: GL09%20EWC
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717305%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717305 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948236%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948236 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993070%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993070 not downloaded yet
2026-03-28 11:04:07 [bca.uk] INFO: Found listing with ID: HW03%20GOA
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW03%2520GOA%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for HW03%20GOA: 1
2026-03-28 11:04:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526 with identifier: HW03%20GOA
2026-03-28 11:04:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698717333%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717333 not downloaded yet
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717203>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948226>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948224>
2026-03-28 11:04:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463088>
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948238%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948238 not downloaded yet
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993090%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993090 not downloaded yet
2026-03-28 11:04:07 [bca.uk] INFO: Found listing with ID: Y856%20RRD
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y856%2520RRD%27 HTTP/1.1" 200 None
2026-03-28 11:04:07 [bca.uk] INFO: Scrape type for Y856%20RRD: 1
2026-03-28 11:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:07 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [crawlers.middlewares.monitoring_spider_middleware] ERROR: Field year is not nullable
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [scrapy.core.scraper] ERROR: Spider error processing <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=6&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search)
Traceback (most recent call last):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/defer.py", line 295, in aiter_errback
yield await it.__anext__()
^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 374, in __anext__
return await self.data.__anext__()
^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/python.py", line 355, in _async_chain
async for o in as_async_generator(it):
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 14, in as_async_generator
async for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy_zyte_api/_middlewares.py", line 206, in process_spider_output_async
async for item_or_request in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/referer.py", line 355, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/urllength.py", line 30, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/local/lib/python3.11/dist-packages/scrapy/spidermiddlewares/depth.py", line 35, in process_spider_output_async
async for r in result or ():
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/photo_download_middleware.py", line 42, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/report_download_middleware.py", line 32, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 121, in process_async
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 118, in process_async
async for r in iterable:
File "/usr/src/app/crawlers/middlewares/id_gen_middleware.py", line 20, in process_spider_output
async for item in result:
File "/usr/local/lib/python3.11/dist-packages/scrapy/utils/asyncgen.py", line 17, in as_async_generator
for r in it:
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 109, in process_sync
exception_result = self._process_spider_exception(
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 150, in _process_spider_exception
result = method(response=response, exception=exception, spider=spider)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/middlewares/monitoring_spider_middleware.py", line 73, in process_spider_exception
raise exception
File "/usr/local/lib/python3.11/dist-packages/scrapy/core/spidermw.py", line 106, in process_sync
for r in iterable:
File "/usr/src/app/crawlers/spiders/bcauk.py", line 735, in parse_listings
yield from self._process_listing_item(item_to_scrape)
File "/usr/src/app/crawlers/spiders/bcauk.py", line 478, in _process_listing_item
item = self._extract_listing_item(item_to_scrape)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "/usr/src/app/crawlers/spiders/bcauk.py", line 804, in _extract_listing_item
item["year"] = year
~~~~^^^^^^^^
File "/usr/src/app/crawlers/items.py", line 116, in __setitem__
raise ValueError(f"Field {key} is not nullable")
ValueError: Field year is not nullable
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697948244%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948244 not downloaded yet
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993113%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993113 not downloaded yet
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993131%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993131 not downloaded yet
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948217/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463081>
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717121/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948220/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993143%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993143 not downloaded yet
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50ec10>
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463067%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463067/600 saved to cache
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50d2d0>
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463065%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463065/600 saved to cache
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e519f90>
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473656%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473656/600 saved to cache
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D682993163%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993163 not downloaded yet
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e36e290>
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_expert_report_file_36d6f3dd-e594-4fd2-ae06-e3201b2c233c.pdf HTTP/1.1" 201 0
2026-03-28 11:04:08 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf083331-75bf-55d8-91b4-b55d09b57bc3, skipping ID generation
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRK16MEU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK16MEU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993070>
2026-03-28 11:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717333>
2026-03-28 11:04:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HW03%20GOA-GB>
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052419%27 HTTP/1.1" 200 None
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052419 not downloaded yet
2026-03-28 11:04:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4eef10>
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948217%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948217/600 saved to cache
2026-03-28 11:04:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c2490>
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717177%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717177/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d4910>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463070%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463070/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcdffd0>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717121%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717121/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc59f50>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948220%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948220/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e541dd0>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717144%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717144/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052454%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052454 not downloaded yet
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993090>
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052476%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052476 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052493%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052493 not downloaded yet
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23c210>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_expert_report_file_b8103218-a65f-4e89-abd2-054567814226.pdf HTTP/1.1" 201 0
2026-03-28 11:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94f53ba1-1a48-56f6-af9c-addac3acf253, skipping ID generation
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPN17YAG-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN17YAG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7f050>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948224%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948224/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7c590>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948226%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948226/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb02750>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463088%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463088/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948244>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993113>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993131>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948238>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948236>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717305>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993143/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993143>
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052513%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052513 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387823%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387823 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052540%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052540 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387832%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387832 not downloaded yet
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e507950>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717203%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717203/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052557%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052557 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387836%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387836 not downloaded yet
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052419>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993163/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993163>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RK16MEU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL09%20EWC-GB>
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698052580%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052580 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387842%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387842 not downloaded yet
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387847%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387847 not downloaded yet
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac1465d0>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463081%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463081/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387854%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387854 not downloaded yet
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993143/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387861%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387861 not downloaded yet
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387872%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387872 not downloaded yet
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387881%27 HTTP/1.1" 200 None
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387881 not downloaded yet
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97e910>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717333%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717333/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387815/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PN17YAG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d3090>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993070%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993070/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e3398d0>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717305%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717305/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8da850>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948236%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948236/600 saved to cache
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d0350>
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_expert_report_file_f40eee9e-4c57-48a3-8854-a87418615994.pdf HTTP/1.1" 201 0
2026-03-28 11:04:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526, skipping ID generation
2026-03-28 11:04:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHW03GOA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HW03GOA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07d50>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993143%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993143/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993163/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387847>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387842>
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814453%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814453 not downloaded yet
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814476%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814476 not downloaded yet
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e6269d0>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993090%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993090/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23e410>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948238%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948238/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e6390>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948244%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948244/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814489%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814489 not downloaded yet
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387815/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387854/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387854>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387836/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387836>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052557/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052557>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387861/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387861>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387832/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387832>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052580/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052580>
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814509%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814509 not downloaded yet
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814524%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814524 not downloaded yet
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e607f90>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052392%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052392/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea88e90>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993131%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993131/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe7b090>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993113%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993113/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaed0d0>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993163%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993163/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d8890>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052419%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052419/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2eb90>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_expert_report_file_bf4bb7b5-75e8-4870-aaba-06ec3c856927.pdf HTTP/1.1" 201 0
2026-03-28 11:04:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acf5b92b-bb35-5c57-bbff-c8eb713ecc47, skipping ID generation
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGL09EWC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GL09EWC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387881>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387872>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387823>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HW03GOA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052540>
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052513>
2026-03-28 11:04:10 [scrapy.extensions.logstats] INFO: Crawled 96 pages (at 24 pages/min), scraped 215 items (at 77 items/min)
2026-03-28 11:04:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814532%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814532 not downloaded yet
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776113%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776113 not downloaded yet
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814545%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814545 not downloaded yet
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776135%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776135 not downloaded yet
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff939d0>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387815%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387815/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814554%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814554 not downloaded yet
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776146%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776146 not downloaded yet
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387832/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814453>
2026-03-28 11:04:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814476>
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387836/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814565%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814565 not downloaded yet
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776174%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776174 not downloaded yet
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052580/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052557/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387861/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776196%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776196 not downloaded yet
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39f450>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387842%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387842/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea5f50>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387847%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387847/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387854/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776213%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776213 not downloaded yet
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776238%27 HTTP/1.1" 200 None
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776238 not downloaded yet
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e381e90>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387832%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387832/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf4310>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387836%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387836/600 saved to cache
2026-03-28 11:04:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e604e10>
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052580%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052580/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe78d90>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052557%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052557/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e605f90>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387861%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387861/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776256%27 HTTP/1.1" 200 None
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776256 not downloaded yet
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776102/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GL09EWC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814524>
2026-03-28 11:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PN17YAG/42783321?sv=2020-08-04&st=2026-03-28T11%3A04%3A07Z&se=2026-03-28T11%3A29%3A07Z&sr=b&sp=r&sig=EGkeW30eNKXk3%2BFBz2m0TaKU98RLkBT1%2FrsnKAetn5g%3D)
2026-03-28 11:04:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776135>
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776146>
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776174>
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814554/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814554>
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814565>
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaee3d0>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387854%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387854/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4f9a50>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387823%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387823/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea24450>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814429%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814429/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c0150>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052540%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052540/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4cc4d0>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052513%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052513/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776196>
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae4693d0>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387872%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387872/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac26c5d0>
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPN17YAG%252F697387881%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387881/600 saved to cache
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 94f53ba1-1a48-56f6-af9c-addac3acf253
2026-03-28 11:04:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 94f53ba1-1a48-56f6-af9c-addac3acf253, skipping ID generation
2026-03-28 11:04:11 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 94f53ba1-1a48-56f6-af9c-addac3acf253 sending to next pipeline
2026-03-28 11:04:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 94f53ba1-1a48-56f6-af9c-addac3acf253, identifier: PN17%20YAG
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 94f53ba1-1a48-56f6-af9c-addac3acf253 with identifier: PN17%20YAG
2026-03-28 11:04:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 94f53ba1-1a48-56f6-af9c-addac3acf253 with identifier: PN17%20YAG
2026-03-28 11:04:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 94f53ba1-1a48-56f6-af9c-addac3acf253 with identifier: PN17%20YAG to the API
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387881/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_expert_report_file_b8103218-a65f-4e89-abd2-054567814226.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PN17%20YAG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '94f53ba1-1a48-56f6-af9c-addac3acf253',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PN17 YAG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PN17%20YAG&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'HR-V',
'odometer': 23486,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53594,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387815/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52329,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387832/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387836/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51935,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387854/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387861/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_94f53ba1-1a48-56f6-af9c-addac3acf253/94f53ba1-1a48-56f6-af9c-addac3acf253_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64981,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PN17YAG/697387881/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'HONDA HR-V 1.5 I-VTEC 130 EX Hatchback',
'transmission': 'automatic',
'trim': 'I-VTEC 130 EX',
'vin': '3HGRU1890HM300566',
'year': 2017}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN17%2520YAG%27 HTTP/1.1" 200 None
2026-03-28 11:04:12 [bca.uk] INFO: Saving data for PN17%20YAG: {'created_time': 1774695852.42377, 'last_price_update_time': 1774695852.423782, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PN17%2520YAG') HTTP/1.1" 204 0
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776113>
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814532/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814532>
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814545/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814545>
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776213/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776213>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac423cd0>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814476%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814476/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776238>
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776102/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94af4bffd0>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814453%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814453/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776256>
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814554/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24be50>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814524%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814524/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d6550>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776102%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776102/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814509/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814509>
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814532/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bdfd0>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814554%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814554/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814545/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776213/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e37c150>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814565%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814565/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac26f310>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776135%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776135/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814489>
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052493/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052493>
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052476/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052476>
2026-03-28 11:04:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052454/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698052454>
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GL09EWC/42807769?sv=2020-08-04&st=2026-03-28T11%3A04%3A09Z&se=2026-03-28T11%3A29%3A09Z&sr=b&sp=r&sig=vD2txF1m3M8sfabQbTJOwAU5%2BXiHS3nkaq3xTLwKDco%3D)
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bd410>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776174%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776174/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac45fcd0>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776146%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776146/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff931d0>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776196%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776196/600 saved to cache
2026-03-28 11:04:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4e9950>
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814532%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814532/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d3cd0>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776113%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776113/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993057>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948234/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948234>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HF57%20DZO-GB>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717281>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463111/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463111>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac25ea10>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814545%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814545/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2f0d0>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776213%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776213/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814509/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948231/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948231>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993042/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=682993042>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2c350>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776238%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776238/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e538050>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGL09EWC%252F698776256%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776256/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47
2026-03-28 11:04:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: acf5b92b-bb35-5c57-bbff-c8eb713ecc47, skipping ID generation
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item acf5b92b-bb35-5c57-bbff-c8eb713ecc47 sending to next pipeline
2026-03-28 11:04:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: acf5b92b-bb35-5c57-bbff-c8eb713ecc47, identifier: GL09%20EWC
2026-03-28 11:04:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: acf5b92b-bb35-5c57-bbff-c8eb713ecc47 with identifier: GL09%20EWC
2026-03-28 11:04:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: acf5b92b-bb35-5c57-bbff-c8eb713ecc47 with identifier: GL09%20EWC
2026-03-28 11:04:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: acf5b92b-bb35-5c57-bbff-c8eb713ecc47 with identifier: GL09%20EWC to the API
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776256/600>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_expert_report_file_bf4bb7b5-75e8-4870-aaba-06ec3c856927.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GL09%20EWC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'acf5b92b-bb35-5c57-bbff-c8eb713ecc47',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GL09 EWC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GL09%20EWC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C3 PICASSO',
'odometer': 145265,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 195964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776102/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 176655,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153887,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 125915,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776213/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 130964,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_acf5b92b-bb35-5c57-bbff-c8eb713ecc47/acf5b92b-bb35-5c57-bbff-c8eb713ecc47_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GL09EWC/698776256/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'CITROEN C3 PICASSO 1.4 VTI 95 VTR+ MPV',
'transmission': 'manual',
'trim': 'VTI 95 VTR+',
'vin': 'VF7SH8FSC9T543004',
'year': 2009}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL09%2520EWC%27 HTTP/1.1" 200 None
2026-03-28 11:04:13 [bca.uk] INFO: Saving data for GL09%20EWC: {'created_time': 1774695853.747175, 'last_price_update_time': 1774695853.74719, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GL09%2520EWC') HTTP/1.1" 204 0
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463104/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463104>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717258>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993032/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FL20CPY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU62%20NWF-GB>
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052454/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052493/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94af309b10>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814509%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814509/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052476/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RK16MEU/42793686?sv=2020-08-04&st=2026-03-28T11%3A04%3A05Z&se=2026-03-28T11%3A29%3A05Z&sr=b&sp=r&sig=%2BQ9lYRZB4oXfSaDF1QZQ7J2k6s4v3xXyyRVsfdR%2F%2BXk%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HW03GOA/42808341?sv=2020-08-04&st=2026-03-28T11%3A04%3A08Z&se=2026-03-28T11%3A29%3A08Z&sr=b&sp=r&sig=XFQJZtVOldSjA4yrr%2FF8b7V4ViDijtjQ2pxKR0Fyb6o%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697948228>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e37f2d0>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052454%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052454/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e36ce10>
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052493%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052493/600 saved to cache
2026-03-28 11:04:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463111/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948231/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948234/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97e3d0>
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRK16MEU%252F698052476%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052476/600 saved to cache
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cf083331-75bf-55d8-91b4-b55d09b57bc3
2026-03-28 11:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cf083331-75bf-55d8-91b4-b55d09b57bc3, skipping ID generation
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cf083331-75bf-55d8-91b4-b55d09b57bc3 sending to next pipeline
2026-03-28 11:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cf083331-75bf-55d8-91b4-b55d09b57bc3, identifier: RK16%20MEU
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5970d0>
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHW03GOA%252F698814489%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814489/600 saved to cache
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526
2026-03-28 11:04:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526, skipping ID generation
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526 sending to next pipeline
2026-03-28 11:04:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526, identifier: HW03%20GOA
2026-03-28 11:04:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fccb410>
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717281%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717281/600 saved to cache
2026-03-28 11:04:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cf083331-75bf-55d8-91b4-b55d09b57bc3 with identifier: RK16%20MEU
2026-03-28 11:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cf083331-75bf-55d8-91b4-b55d09b57bc3 with identifier: RK16%20MEU
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cf083331-75bf-55d8-91b4-b55d09b57bc3 with identifier: RK16%20MEU to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052476/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_expert_report_file_36d6f3dd-e594-4fd2-ae06-e3201b2c233c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RK16%20MEU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cf083331-75bf-55d8-91b4-b55d09b57bc3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RK16 MEU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RK16%20MEU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'CEED',
'odometer': 70207,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182433,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052454/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052493/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052513/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 145127,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052557/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cf083331-75bf-55d8-91b4-b55d09b57bc3/cf083331-75bf-55d8-91b4-b55d09b57bc3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RK16MEU/698052580/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA CEED 1.0 T GDI 120 GT-LINE ISG Hatchback',
'transmission': 'manual',
'trim': 'T GDI 120 GT-LINE ISG',
'vin': 'U5YHN51ALGL237385',
'year': 2016}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK16%2520MEU%27 HTTP/1.1" 200 None
2026-03-28 11:04:14 [bca.uk] INFO: Saving data for RK16%20MEU: {'created_time': 1774695854.793134, 'last_price_update_time': 1774695854.793147, 'auction_closing_time': 1774951200.0}
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RK16%2520MEU') HTTP/1.1" 204 0
2026-03-28 11:04:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526 with identifier: HW03%20GOA
2026-03-28 11:04:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526 with identifier: HW03%20GOA
2026-03-28 11:04:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526 with identifier: HW03%20GOA to the API
2026-03-28 11:04:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814489/600>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_expert_report_file_f40eee9e-4c57-48a3-8854-a87418615994.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HW03%20GOA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HW03 GOA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HW03%20GOA&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '206 CC',
'odometer': 68195,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 10,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 189231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 201898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814476/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814509/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 144686,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 162934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 134138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814545/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 153279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814554/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526/0fe99cbb-8f99-5f9a-9b3c-c37b6e9c9526_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 200263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HW03GOA/698814565/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'PEUGEOT 206 CC 1.6 ALLURE Convertible',
'transmission': 'manual',
'trim': 'ALLURE',
'vin': 'VF32DNFUF43426811',
'year': 2003}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW03%2520GOA%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [bca.uk] INFO: Saving data for HW03%20GOA: {'created_time': 1774695855.231477, 'last_price_update_time': 1774695855.23149, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HW03%2520GOA') HTTP/1.1" 204 0
2026-03-28 11:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993042/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698717226>
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463093/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463093>
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB65%20ELU-GB>
2026-03-28 11:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463104/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993032/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FL20CPY/42809567?sv=2020-08-04&st=2026-03-28T11%3A04%3A02Z&se=2026-03-28T11%3A29%3A02Z&sr=b&sp=r&sig=PNsoWESVUEN4lbeo9DUnKV96qxhp7oZVr9f2sghb7Hs%3D)
2026-03-28 11:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97f110>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463111%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463111/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2b610>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948231%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948231/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc9350>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993057%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993057/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4f9990>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948234%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948234/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e37db90>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717258%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717258/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2abd0>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_expert_report_file_9390fd2f-6e1e-47c5-a522-b57a8c1e46fa.pdf HTTP/1.1" 201 0
2026-03-28 11:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f41977d4-aa4c-5c65-a9f6-75359a06d1d3, skipping ID generation
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHF57DZO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HF57DZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697463073>
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473670>
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473659/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473659>
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698473663>
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717099/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LG08RMU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LL61ZWT/42809605?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=68GmuePBf8PkKBgTzM5OqxrrOXlRQPJJIDGniEeZl8A%3D)
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703107%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703107 not downloaded yet
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703112%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703112 not downloaded yet
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e338850>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993042%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993042/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e550f10>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463104%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463104/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9bba10>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFL20CPY%252F682993032%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993032/600 saved to cache
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c55db6a9-0058-5b15-9854-0020af84912b
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c55db6a9-0058-5b15-9854-0020af84912b, skipping ID generation
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c55db6a9-0058-5b15-9854-0020af84912b sending to next pipeline
2026-03-28 11:04:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c55db6a9-0058-5b15-9854-0020af84912b, identifier: FL20%20CPY
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8dd4d0>
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_expert_report_file_232cf827-f22f-4c4e-949c-e2ef5c45060c.pdf HTTP/1.1" 201 0
2026-03-28 11:04:15 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53a14b43-8d32-5a4d-ac93-9ace42126b1a, skipping ID generation
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGU62NWF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU62NWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197762>
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703116%27 HTTP/1.1" 200 None
2026-03-28 11:04:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703116 not downloaded yet
2026-03-28 11:04:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c55db6a9-0058-5b15-9854-0020af84912b with identifier: FL20%20CPY
2026-03-28 11:04:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c55db6a9-0058-5b15-9854-0020af84912b with identifier: FL20%20CPY
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c55db6a9-0058-5b15-9854-0020af84912b with identifier: FL20%20CPY to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993032/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_expert_report_file_f083dfa8-79bc-4a86-b947-74855bd52595.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL20%20CPY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c55db6a9-0058-5b15-9854-0020af84912b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL20 CPY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL20%20CPY&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '520D',
'odometer': 33649,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175878,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993042/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 208720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 211956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 171617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 138975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154412,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993143/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c55db6a9-0058-5b15-9854-0020af84912b/c55db6a9-0058-5b15-9854-0020af84912b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FL20CPY/682993163/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 MHT M SPORT Saloon',
'transmission': 'automatic',
'trim': 'MHT M SPORT',
'vin': 'WBA12DW000WW80165',
'year': 2020}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL20%2520CPY%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [bca.uk] INFO: Saving data for FL20%20CPY: {'created_time': 1774695856.300476, 'last_price_update_time': 1774695856.300488, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL20%2520CPY') HTTP/1.1" 204 0
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GJ58HSC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197731>
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682151/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682151>
2026-03-28 11:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD18%20CVW-GB>
2026-03-28 11:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463093/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681947%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681947 not downloaded yet
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703118%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703118 not downloaded yet
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681971%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681971 not downloaded yet
2026-03-28 11:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703122%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703122 not downloaded yet
2026-03-28 11:04:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e554510>
2026-03-28 11:04:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLL61ZWT%252F697948228%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948228/600 saved to cache
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8
2026-03-28 11:04:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37d571a3-cd69-5f7b-9025-adff3b75dcf8, skipping ID generation
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37d571a3-cd69-5f7b-9025-adff3b75dcf8 sending to next pipeline
2026-03-28 11:04:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 37d571a3-cd69-5f7b-9025-adff3b75dcf8, identifier: LL61%20ZWT
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681991%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681991 not downloaded yet
2026-03-28 11:04:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 37d571a3-cd69-5f7b-9025-adff3b75dcf8 with identifier: LL61%20ZWT
2026-03-28 11:04:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 37d571a3-cd69-5f7b-9025-adff3b75dcf8 with identifier: LL61%20ZWT
2026-03-28 11:04:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 37d571a3-cd69-5f7b-9025-adff3b75dcf8 with identifier: LL61%20ZWT to the API
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948228/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_expert_report_file_9e077f53-a841-4d91-9b7a-7c6a64e675d3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL61%20ZWT-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '37d571a3-cd69-5f7b-9025-adff3b75dcf8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL61 ZWT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL61%20ZWT&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 124720,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948220/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51078,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948224/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53573,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54218,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50384,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948231/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948234/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948236/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37d571a3-cd69-5f7b-9025-adff3b75dcf8/37d571a3-cd69-5f7b-9025-adff3b75dcf8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LL61ZWT/697948244/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 2.0 CDTI 16V 165 SE Hatchback',
'transmission': 'automatic',
'trim': 'CDTI 16V 165 SE',
'vin': 'W0LPE6EN3CG047671',
'year': 2011}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL61%2520ZWT%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [bca.uk] INFO: Saving data for LL61%20ZWT: {'created_time': 1774695856.952335, 'last_price_update_time': 1774695856.952403, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL61%2520ZWT') HTTP/1.1" 204 0
2026-03-28 11:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717099/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LG08RMU/42809753?sv=2020-08-04&st=2026-03-28T11%3A03%3A58Z&se=2026-03-28T11%3A28%3A58Z&sr=b&sp=r&sig=nLALDsxAFrxNU2%2Bi7bJR6Ie5JztwbVGBIhuAMUwqI5c%3D)
2026-03-28 11:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197728/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698197728>
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682030>
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703126%27 HTTP/1.1" 200 None
2026-03-28 11:04:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703126 not downloaded yet
2026-03-28 11:04:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703106/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HF57DZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473659/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ND12LBP/42800609?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=mqLHGp%2Fjk0Qy48fEqpj%2Ffu%2B%2F56p5yGfHE0UDFFZIhcA%3D)
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682011%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682011 not downloaded yet
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703131%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703131 not downloaded yet
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e555b90>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717226%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717226/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec8b90>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463093%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463093/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff9a710>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_expert_report_file_791ae695-562c-40eb-aa0f-3b6676b63111.pdf HTTP/1.1" 201 0
2026-03-28 11:04:17 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41bfed47-06be-532e-8f54-e5c676d90605, skipping ID generation
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYB65ELU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YB65ELU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682031%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682031 not downloaded yet
2026-03-28 11:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GJ58HSC/42784254?sv=2020-08-04&st=2026-03-28T11%3A03%3A57Z&se=2026-03-28T11%3A28%3A57Z&sr=b&sp=r&sig=d%2BQ%2FahLp%2F9%2BB9dockLxb79YnX3QCZXG6NqUnvBSOHP8%3D)
2026-03-28 11:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703135%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703135 not downloaded yet
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628649%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628649 not downloaded yet
2026-03-28 11:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682151/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682059%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682059 not downloaded yet
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9e4750>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLG08RMU%252F698717099%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717099/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 93ba7a6a-2703-5b61-8fe2-d2f537296d23, skipping ID generation
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 93ba7a6a-2703-5b61-8fe2-d2f537296d23 sending to next pipeline
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 93ba7a6a-2703-5b61-8fe2-d2f537296d23, identifier: LG08%20RMU
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad18dd50>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463073%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463073/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d15d0>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473663%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473663/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e391ad0>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473659%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473659/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8de990>
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FND12LBP%252F698473670%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473670/600 saved to cache
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 325ff223-af4d-52f5-a85f-e14f2e547fe2
2026-03-28 11:04:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 325ff223-af4d-52f5-a85f-e14f2e547fe2, skipping ID generation
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 325ff223-af4d-52f5-a85f-e14f2e547fe2 sending to next pipeline
2026-03-28 11:04:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 325ff223-af4d-52f5-a85f-e14f2e547fe2, identifier: ND12%20LBP
2026-03-28 11:04:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703112>
2026-03-28 11:04:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703118>
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697703141%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703141 not downloaded yet
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628669%27 HTTP/1.1" 200 None
2026-03-28 11:04:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628669 not downloaded yet
2026-03-28 11:04:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 93ba7a6a-2703-5b61-8fe2-d2f537296d23 with identifier: LG08%20RMU
2026-03-28 11:04:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 93ba7a6a-2703-5b61-8fe2-d2f537296d23 with identifier: LG08%20RMU
2026-03-28 11:04:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 93ba7a6a-2703-5b61-8fe2-d2f537296d23 with identifier: LG08%20RMU to the API
2026-03-28 11:04:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717099/600>
{'auction_title': '',
'c_o_2_emission_value': 142,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_expert_report_file_63ffa086-ef41-46ac-8588-4e163d93beba.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG08%20RMU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '93ba7a6a-2703-5b61-8fe2-d2f537296d23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG08 RMU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG08%20RMU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': '318I',
'odometer': 136183,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717099/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717121/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52705,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95127,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90646,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_93ba7a6a-2703-5b61-8fe2-d2f537296d23/93ba7a6a-2703-5b61-8fe2-d2f537296d23_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71009,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LG08RMU/698717333/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'BMW 318I 2.0 143 SE Saloon',
'transmission': 'manual',
'trim': '143 SE',
'vin': 'WBAVF52010A335841',
'year': 2008}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG08%2520RMU%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [bca.uk] INFO: Saving data for LG08%20RMU: {'created_time': 1774695858.25251, 'last_price_update_time': 1774695858.252522, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG08%2520RMU') HTTP/1.1" 204 0
2026-03-28 11:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 325ff223-af4d-52f5-a85f-e14f2e547fe2 with identifier: ND12%20LBP
2026-03-28 11:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 325ff223-af4d-52f5-a85f-e14f2e547fe2 with identifier: ND12%20LBP
2026-03-28 11:04:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 325ff223-af4d-52f5-a85f-e14f2e547fe2 with identifier: ND12%20LBP to the API
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473670/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_expert_report_file_fb0df974-a6b6-4d45-99b4-62f0c8df68d5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND12%20LBP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '325ff223-af4d-52f5-a85f-e14f2e547fe2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND12 LBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND12%20LBP&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 113174,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51864,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473621/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52174,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473628/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51429,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473647/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473651/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72170,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473659/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473663/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_325ff223-af4d-52f5-a85f-e14f2e547fe2/325ff223-af4d-52f5-a85f-e14f2e547fe2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ND12LBP/698473670/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TDCI 70 EDGE Hatchback',
'transmission': 'manual',
'trim': 'TDCI 70 EDGE',
'vin': 'WF0JXXGAJJCA12056',
'year': 2012}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520LBP%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [bca.uk] INFO: Saving data for ND12%20LBP: {'created_time': 1774695858.671856, 'last_price_update_time': 1774695858.671868, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND12%2520LBP') HTTP/1.1" 204 0
2026-03-28 11:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU62NWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682090%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682090 not downloaded yet
2026-03-28 11:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703122/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703122>
2026-03-28 11:04:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197728/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628687%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628687 not downloaded yet
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8aa910>
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGJ58HSC%252F697463062%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463062/600 saved to cache
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7
2026-03-28 11:04:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7, skipping ID generation
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 sending to next pipeline
2026-03-28 11:04:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7, identifier: GJ58%20HSC
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4efe50>
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197731%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197731/600 saved to cache
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcaf350>
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698682151%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682151/600 saved to cache
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682113%27 HTTP/1.1" 200 None
2026-03-28 11:04:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682113 not downloaded yet
2026-03-28 11:04:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC
2026-03-28 11:04:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC
2026-03-28 11:04:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 79b41b88-9fb1-5e41-8e2d-c04e37c087a7 with identifier: GJ58%20HSC to the API
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463062/600>
{'auction_title': '',
'c_o_2_emission_value': 204,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_expert_report_file_3c3ee5bb-a8d3-4ad4-b266-d05993d04838.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GJ58%20HSC-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '79b41b88-9fb1-5e41-8e2d-c04e37c087a7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GJ58 HSC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GJ58%20HSC&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'CLC 200K',
'odometer': 135081,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58679,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52575,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50980,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50219,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463093/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463104/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79b41b88-9fb1-5e41-8e2d-c04e37c087a7/79b41b88-9fb1-5e41-8e2d-c04e37c087a7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59905,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GJ58HSC/697463111/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ CLC 200K 1.8 SPORT Coupe',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WDB2037412E047382',
'year': 2008}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ58%2520HSC%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [bca.uk] INFO: Saving data for GJ58%20HSC: {'created_time': 1774695859.410033, 'last_price_update_time': 1774695859.410044, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GJ58%2520HSC') HTTP/1.1" 204 0
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703106/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681971>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703126>
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628709%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628709 not downloaded yet
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e82c110>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_expert_report_file_7d8485c9-95e1-49f1-a92c-d8dbab59faa4.pdf HTTP/1.1" 201 0
2026-03-28 11:04:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff90612e-f16f-5f6b-a6b0-98d7117c35f6, skipping ID generation
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD18CVW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD18CVW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681991>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703131>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682031/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682031>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681947>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YB65ELU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682141%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682141 not downloaded yet
2026-03-28 11:04:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23b310>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197762%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197762/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb069d0>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698682030%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682030/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7fb10>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197728%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197728/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628736%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628736 not downloaded yet
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671435%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671435 not downloaded yet
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628649>
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628765%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628765 not downloaded yet
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671461%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671461 not downloaded yet
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703122/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703141>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682059>
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628669>
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628788%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628788 not downloaded yet
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671485%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671485 not downloaded yet
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3f1d0>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703106%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703106/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628687>
2026-03-28 11:04:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628824%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628824 not downloaded yet
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671502%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671502 not downloaded yet
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698628853%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628853 not downloaded yet
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671531%27 HTTP/1.1" 200 None
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671531 not downloaded yet
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d8210>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703112%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703112/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8dc650>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703118%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703118/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7fed0>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703122%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703122/600 saved to cache
2026-03-28 11:04:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39f2d0>
2026-03-28 11:04:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698681936%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681936/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671561%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671561 not downloaded yet
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682031/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682141>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD18CVW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671587%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671587 not downloaded yet
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8a8050>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698681971%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681971/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39eb50>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703126%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703126/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671610%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671610 not downloaded yet
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671461/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671461>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628765>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628788>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671485>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671633%27 HTTP/1.1" 200 None
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671633 not downloaded yet
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac40c950>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628630%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628630/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd06210>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698681947%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681947/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb00810>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698682031%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682031/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4e9910>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698681991%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681991/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb01450>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628649%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628649/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fde8990>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703131%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703131/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628824>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671531>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628853/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628853>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671502>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671435/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671435>
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628736/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628736>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb00890>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628669%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628669/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e85c990>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628687%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628687/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea77150>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703141%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703141/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2f7d0>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698682059%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682059/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671587/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671587>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671561/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671561>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671461/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671610>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac25c650>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671413%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671413/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae462050>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698682141%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682141/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698628709>
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628736/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fde9310>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628788%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628788/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628853/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671633/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671633>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e6210>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671461%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671461/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50d310>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671485%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671485/600 saved to cache
2026-03-28 11:04:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:20 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3d250>
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628765%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628765/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671435/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682090>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682113/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682113>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703135>
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671561/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671587/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c4210>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671502%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671502/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e410210>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628736%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628736/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4128d0>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628824%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628824/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcafbd0>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671531%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671531/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb06390>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628853%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628853/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682011>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703116/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703116>
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YB65ELU/42808058?sv=2020-08-04&st=2026-03-28T11%3A04%3A14Z&se=2026-03-28T11%3A29%3A14Z&sr=b&sp=r&sig=6DRTOUDe9iftpE%2FZpavmIBjBltC9Iimy27MCsyz%2F8ZE%3D)
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU19%20RWF-GB>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775923>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703107/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697703107>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX70%20UBS-GB>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775894/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775894>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GR21%20HBF-GB>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX18%20LZV-GB>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HV64ZMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775852>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e410a10>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671435%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671435/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50d310>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671610%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671610/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae46fd50>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671561%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671561/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e847a90>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671587%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671587/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682113/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671633/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD18CVW/42809571?sv=2020-08-04&st=2026-03-28T11%3A04%3A15Z&se=2026-03-28T11%3A29%3A15Z&sr=b&sp=r&sig=qsLWPPmyT45icdVL3jV%2FGjUGJBP5PGrmhiDAoLx14i8%3D)
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff7fd10>
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYB65ELU%252F698628709%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628709/600 saved to cache
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 41bfed47-06be-532e-8f54-e5c676d90605
2026-03-28 11:04:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41bfed47-06be-532e-8f54-e5c676d90605, skipping ID generation
2026-03-28 11:04:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41bfed47-06be-532e-8f54-e5c676d90605 sending to next pipeline
2026-03-28 11:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41bfed47-06be-532e-8f54-e5c676d90605, identifier: YB65%20ELU
2026-03-28 11:04:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41bfed47-06be-532e-8f54-e5c676d90605 with identifier: YB65%20ELU
2026-03-28 11:04:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41bfed47-06be-532e-8f54-e5c676d90605 with identifier: YB65%20ELU
2026-03-28 11:04:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41bfed47-06be-532e-8f54-e5c676d90605 with identifier: YB65%20ELU to the API
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628709/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_expert_report_file_791ae695-562c-40eb-aa0f-3b6676b63111.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YB65%20ELU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '41bfed47-06be-532e-8f54-e5c676d90605',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YB65 ELU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YB65%20ELU&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MINI',
'model': 'ONE',
'odometer': 18665,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628649/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52057,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628709/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98746,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bfed47-06be-532e-8f54-e5c676d90605/41bfed47-06be-532e-8f54-e5c676d90605_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106166,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YB65ELU/698628853/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MINI ONE 1.2 102 Hatchback',
'transmission': 'manual',
'trim': '102',
'vin': 'WMWXN720302D83135',
'year': 2015}
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB65%2520ELU%27 HTTP/1.1" 200 None
2026-03-28 11:04:22 [bca.uk] INFO: Saving data for YB65%20ELU: {'created_time': 1774695862.597516, 'last_price_update_time': 1774695862.597531, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YB65%2520ELU') HTTP/1.1" 204 0
2026-03-28 11:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703107/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703116/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HF57DZO/42790087?sv=2020-08-04&st=2026-03-28T11%3A04%3A12Z&se=2026-03-28T11%3A29%3A12Z&sr=b&sp=r&sig=yd3lhcaJIRxmWjevY32lqtCooUEzFkSPBdAy%2Bd5Vp68%3D)
2026-03-28 11:04:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681955/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681955>
2026-03-28 11:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU62NWF/42809742?sv=2020-08-04&st=2026-03-28T11%3A04%3A13Z&se=2026-03-28T11%3A29%3A13Z&sr=b&sp=r&sig=zXp9e4ABPWUJ5RIxfwADUo0AryNeBqtULRXa%2BxCKT8k%3D)
2026-03-28 11:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775894/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e33aa90>
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703135%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703135/600 saved to cache
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bce90>
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698682113%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682113/600 saved to cache
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e51a010>
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698682090%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682090/600 saved to cache
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:22 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd28690>
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD18CVW%252F698671633%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671633/600 saved to cache
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6
2026-03-28 11:04:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ff90612e-f16f-5f6b-a6b0-98d7117c35f6, skipping ID generation
2026-03-28 11:04:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ff90612e-f16f-5f6b-a6b0-98d7117c35f6 sending to next pipeline
2026-03-28 11:04:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ff90612e-f16f-5f6b-a6b0-98d7117c35f6, identifier: FD18%20CVW
2026-03-28 11:04:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ff90612e-f16f-5f6b-a6b0-98d7117c35f6 with identifier: FD18%20CVW
2026-03-28 11:04:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ff90612e-f16f-5f6b-a6b0-98d7117c35f6 with identifier: FD18%20CVW
2026-03-28 11:04:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ff90612e-f16f-5f6b-a6b0-98d7117c35f6 with identifier: FD18%20CVW to the API
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671633/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_expert_report_file_7d8485c9-95e1-49f1-a92c-d8dbab59faa4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD18%20CVW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ff90612e-f16f-5f6b-a6b0-98d7117c35f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD18 CVW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD18%20CVW&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 20061,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52720,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671435/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671461/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671485/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671531/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671561/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671587/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ff90612e-f16f-5f6b-a6b0-98d7117c35f6/ff90612e-f16f-5f6b-a6b0-98d7117c35f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD18CVW/698671633/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SEAT IBIZA 1.0 SE TECHNOLOGY Hatchback',
'transmission': 'manual',
'trim': 'SE TECHNOLOGY',
'vin': 'VSSZZZKJZJR162554',
'year': 2018}
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD18%2520CVW%27 HTTP/1.1" 200 None
2026-03-28 11:04:23 [bca.uk] INFO: Saving data for FD18%20CVW: {'created_time': 1774695863.597441, 'last_price_update_time': 1774695863.597452, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD18%2520CVW') HTTP/1.1" 204 0
2026-03-28 11:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HV64ZMX/42796562?sv=2020-08-04&st=2026-03-28T11%3A03%3A54Z&se=2026-03-28T11%3A28%3A54Z&sr=b&sp=r&sig=wPAHCHklgLXHjVw420JxYxfgflH9KhFjMkdF7V3Lpfo%3D)
2026-03-28 11:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK16%20BTV-GB>
2026-03-28 11:04:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775821/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775821>
2026-03-28 11:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:04:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9b150>
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703107%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703107/600 saved to cache
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4f7d90>
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHF57DZO%252F697703116%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703116/600 saved to cache
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3
2026-03-28 11:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f41977d4-aa4c-5c65-a9f6-75359a06d1d3, skipping ID generation
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f41977d4-aa4c-5c65-a9f6-75359a06d1d3 sending to next pipeline
2026-03-28 11:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f41977d4-aa4c-5c65-a9f6-75359a06d1d3, identifier: HF57%20DZO
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e85ff90>
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU62NWF%252F698682011%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682011/600 saved to cache
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a
2026-03-28 11:04:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 53a14b43-8d32-5a4d-ac93-9ace42126b1a, skipping ID generation
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 53a14b43-8d32-5a4d-ac93-9ace42126b1a sending to next pipeline
2026-03-28 11:04:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53a14b43-8d32-5a4d-ac93-9ace42126b1a, identifier: GU62%20NWF
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e38d0>
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775894%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775894/600 saved to cache
2026-03-28 11:04:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4f6810>
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775923%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775923/600 saved to cache
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb01fd0>
2026-03-28 11:04:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_expert_report_file_ea0ceb54-79fb-4187-b5fd-9482b2ec83df.pdf HTTP/1.1" 201 0
2026-03-28 11:04:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5a2781a-bf30-515d-96de-139303c8d44d, skipping ID generation
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDX70UBS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX70UBS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f41977d4-aa4c-5c65-a9f6-75359a06d1d3 with identifier: HF57%20DZO
2026-03-28 11:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f41977d4-aa4c-5c65-a9f6-75359a06d1d3 with identifier: HF57%20DZO
2026-03-28 11:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f41977d4-aa4c-5c65-a9f6-75359a06d1d3 with identifier: HF57%20DZO to the API
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703116/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_expert_report_file_9390fd2f-6e1e-47c5-a522-b57a8c1e46fa.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HF57%20DZO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f41977d4-aa4c-5c65-a9f6-75359a06d1d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HF57 DZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HF57%20DZO&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 46559,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703106/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52243,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703107/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55108,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703116/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703118/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703122/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75980,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f41977d4-aa4c-5c65-a9f6-75359a06d1d3/f41977d4-aa4c-5c65-a9f6-75359a06d1d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72863,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HF57DZO/697703141/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE CVT-7',
'vin': 'LUCGE385073213920',
'year': 2007}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF57%2520DZO%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [bca.uk] INFO: Saving data for HF57%20DZO: {'created_time': 1774695864.513811, 'last_price_update_time': 1774695864.513821, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HF57%2520DZO') HTTP/1.1" 204 0
2026-03-28 11:04:24 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53a14b43-8d32-5a4d-ac93-9ace42126b1a with identifier: GU62%20NWF
2026-03-28 11:04:24 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53a14b43-8d32-5a4d-ac93-9ace42126b1a with identifier: GU62%20NWF
2026-03-28 11:04:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53a14b43-8d32-5a4d-ac93-9ace42126b1a with identifier: GU62%20NWF to the API
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682011/600>
{'auction_title': '',
'c_o_2_emission_value': 132,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_expert_report_file_232cf827-f22f-4c4e-949c-e2ef5c45060c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU62%20NWF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53a14b43-8d32-5a4d-ac93-9ace42126b1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU62 NWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU62%20NWF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MAZDA',
'model': '2',
'odometer': 22366,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53297,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681947/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53784,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698681991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55942,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52628,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682031/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72673,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682113/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_53a14b43-8d32-5a4d-ac93-9ace42126b1a/53a14b43-8d32-5a4d-ac93-9ace42126b1a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71233,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU62NWF/698682141/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'MAZDA 2 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'JMZDEA45210468371',
'year': 2012}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520NWF%27 HTTP/1.1" 200 None
2026-03-28 11:04:24 [bca.uk] INFO: Saving data for GU62%20NWF: {'created_time': 1774695864.964923, 'last_price_update_time': 1774695864.964934, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU62%2520NWF') HTTP/1.1" 204 0
2026-03-28 11:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775786>
2026-03-28 11:04:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681955/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/H9HBE/42809640?sv=2020-08-04&st=2026-03-28T11%3A03%3A52Z&se=2026-03-28T11%3A28%3A52Z&sr=b&sp=r&sig=YmcT3eCb1%2Bi%2BUqP2CAuYRXjaB7BrFvUgxaHKrp3tIGA%3D)
2026-03-28 11:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793146>
2026-03-28 11:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF51%20EOS-GB>
2026-03-28 11:04:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK61%20NMX-GB>
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681963%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681963 not downloaded yet
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN63%20YUK-GB>
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768037>
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681982%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681982 not downloaded yet
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebbd290>
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_expert_report_file_7b691d4c-1752-4993-99a0-09e19cd60947.pdf HTTP/1.1" 201 0
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d110be31-ad93-5365-9ead-c1775f8e8e2b, skipping ID generation
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEU19RWF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EU19RWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ede10>
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHV64ZMX%252F698197717%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197717/600 saved to cache
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 41bf9816-8fd1-5167-9917-2be2811cb13e
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 41bf9816-8fd1-5167-9917-2be2811cb13e, skipping ID generation
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 41bf9816-8fd1-5167-9917-2be2811cb13e sending to next pipeline
2026-03-28 11:04:25 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 41bf9816-8fd1-5167-9917-2be2811cb13e, identifier: HV64%20ZMX
2026-03-28 11:04:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc24450>
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775852%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775852/600 saved to cache
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e518ed0>
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_expert_report_file_0ca50938-ece5-4ea8-976e-176de1ddce27.pdf HTTP/1.1" 201 0
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24623035-d9ac-5881-a02b-df41247ee5f0, skipping ID generation
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGR21HBF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GR21HBF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97c910>
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_expert_report_file_7f6d2c67-c731-41ff-a266-cf28009f66df.pdf HTTP/1.1" 201 0
2026-03-28 11:04:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc, skipping ID generation
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRX18LZV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX18LZV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682003%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682003 not downloaded yet
2026-03-28 11:04:25 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX
2026-03-28 11:04:25 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX
2026-03-28 11:04:25 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 41bf9816-8fd1-5167-9917-2be2811cb13e with identifier: HV64%20ZMX to the API
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:25 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197717/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_expert_report_file_2ce0624e-92e8-4a1b-a6cd-3d083a2a77bf.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV64%20ZMX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '41bf9816-8fd1-5167-9917-2be2811cb13e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV64 ZMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV64%20ZMX&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '320D',
'odometer': 194320,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56181,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197721/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54405,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197728/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48923,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197737/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197744/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85513,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103453,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197762/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_41bf9816-8fd1-5167-9917-2be2811cb13e/41bf9816-8fd1-5167-9917-2be2811cb13e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HV64ZMX/698197768/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'SPORT TOURING STEP',
'vin': 'WBA3K32060K403181',
'year': 2014}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV64%2520ZMX%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [bca.uk] INFO: Saving data for HV64%20ZMX: {'created_time': 1774695865.723803, 'last_price_update_time': 1774695865.723814, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV64%2520ZMX') HTTP/1.1" 204 0
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768022/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768022>
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483613>
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483599>
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793141>
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR63%20WBM-GB>
2026-03-28 11:04:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802174/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802174>
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682000%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682000 not downloaded yet
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671437%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671437 not downloaded yet
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671727%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671727 not downloaded yet
2026-03-28 11:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775821/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682020%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682020 not downloaded yet
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682023%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682023 not downloaded yet
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671465%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671465 not downloaded yet
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671756%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671756 not downloaded yet
2026-03-28 11:04:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682040%27 HTTP/1.1" 200 None
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682040 not downloaded yet
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a1650>
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FH9HBE%252F698681955%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681955/600 saved to cache
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab
2026-03-28 11:04:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c6b92bfb-395f-5a0f-be4a-ffaa99683dab, skipping ID generation
2026-03-28 11:04:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c6b92bfb-395f-5a0f-be4a-ffaa99683dab sending to next pipeline
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c6b92bfb-395f-5a0f-be4a-ffaa99683dab, identifier: H9%20HBE
2026-03-28 11:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698768003>
2026-03-28 11:04:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX70UBS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AO60TNJ/42807714?sv=2020-08-04&st=2026-03-28T11%3A03%3A49Z&se=2026-03-28T11%3A28%3A49Z&sr=b&sp=r&sig=sLF4D10lVXOgV1muHEebs9HWZODTs5u0NavdWeb2D0Y%3D)
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682043%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682043 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671486%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671486 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671781%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671781 not downloaded yet
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c6b92bfb-395f-5a0f-be4a-ffaa99683dab with identifier: H9%20HBE
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c6b92bfb-395f-5a0f-be4a-ffaa99683dab with identifier: H9%20HBE
2026-03-28 11:04:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c6b92bfb-395f-5a0f-be4a-ffaa99683dab with identifier: H9%20HBE to the API
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681955/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_expert_report_file_cb9337f3-aa2b-4e61-b6c2-1c6c82667e1c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=H9%20HBE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c6b92bfb-395f-5a0f-be4a-ffaa99683dab',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'H9 HBE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=H9%20HBE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 98371,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50765,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681955/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681967/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698681989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 104063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682091/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682120/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682151/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c6b92bfb-395f-5a0f-be4a-ffaa99683dab/c6b92bfb-395f-5a0f-be4a-ffaa99683dab_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74840,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/H9HBE/698682183/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.4 TSI 122 MATCH DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 122 MATCH DSG',
'vin': 'WVWZZZ1KZ9W039977',
'year': 2008}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27H9%2520HBE%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [bca.uk] INFO: Saving data for H9%20HBE: {'created_time': 1774695866.525211, 'last_price_update_time': 1774695866.525224, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='H9%2520HBE') HTTP/1.1" 204 0
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768037/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682066%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682066 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682060%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682060 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671520%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671520 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671812%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671812 not downloaded yet
2026-03-28 11:04:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94af4bff90>
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775821%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775821/600 saved to cache
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec2c50>
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_expert_report_file_7525c8f6-8bcd-424b-a835-d6cb6a103f29.pdf HTTP/1.1" 201 0
2026-03-28 11:04:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699, skipping ID generation
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVK16BTV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK16BTV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682097%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682097 not downloaded yet
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802174/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60AGX/42808072?sv=2020-08-04&st=2026-03-28T11%3A03%3A34Z&se=2026-03-28T11%3A28%3A34Z&sr=b&sp=r&sig=bMtlIP4HLrSwsDFXt%2FrE2i4EwnLTqlfdXdr26xsYVO0%3D)
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682080%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682080 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671541%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671541 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671848%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671848 not downloaded yet
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681937%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681937 not downloaded yet
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3f750>
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAO60TNJ%252F698775786%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775786/600 saved to cache
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d
2026-03-28 11:04:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46ca9b47-7e63-553f-bf45-5039f76f4c7d, skipping ID generation
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46ca9b47-7e63-553f-bf45-5039f76f4c7d sending to next pipeline
2026-03-28 11:04:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46ca9b47-7e63-553f-bf45-5039f76f4c7d, identifier: AO60%20TNJ
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682126%27 HTTP/1.1" 200 None
2026-03-28 11:04:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682126 not downloaded yet
2026-03-28 11:04:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ
2026-03-28 11:04:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46ca9b47-7e63-553f-bf45-5039f76f4c7d with identifier: AO60%20TNJ to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775786/600>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_expert_report_file_3648d731-5738-4165-a6c7-4a5c3bb1698c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AO60%20TNJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '46ca9b47-7e63-553f-bf45-5039f76f4c7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AO60 TNJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AO60%20TNJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'HONDA',
'model': 'INSIGHT',
'odometer': 136313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775736/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775771/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71895,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775894/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46ca9b47-7e63-553f-bf45-5039f76f4c7d/46ca9b47-7e63-553f-bf45-5039f76f4c7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AO60TNJ/698775923/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'HONDA INSIGHT 1.3 IMA ES HYBRID Hatchback',
'transmission': 'automatic',
'trim': 'IMA ES HYBRID',
'vin': 'JHMZE2870BS201214',
'year': 2011}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO60%2520TNJ%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [bca.uk] INFO: Saving data for AO60%20TNJ: {'created_time': 1774695867.368848, 'last_price_update_time': 1774695867.368862, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AO60%2520TNJ') HTTP/1.1" 204 0
2026-03-28 11:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682103%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682103 not downloaded yet
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671565%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671565 not downloaded yet
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671888%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671888 not downloaded yet
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681952%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681952 not downloaded yet
2026-03-28 11:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682003>
2026-03-28 11:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682166%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682166 not downloaded yet
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7fed0>
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698768037%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768037/600 saved to cache
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2ec50>
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793146%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793146/600 saved to cache
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3cad10>
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802174%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802174/600 saved to cache
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2ca90>
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60AGX%252F698793141%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793141/600 saved to cache
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 98ba0866-113f-5795-bc05-eca7493443d3
2026-03-28 11:04:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 98ba0866-113f-5795-bc05-eca7493443d3, skipping ID generation
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 98ba0866-113f-5795-bc05-eca7493443d3 sending to next pipeline
2026-03-28 11:04:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 98ba0866-113f-5795-bc05-eca7493443d3, identifier: SD60%20AGX
2026-03-28 11:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682020>
2026-03-28 11:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768022/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682135%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682135 not downloaded yet
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671589%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671589 not downloaded yet
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671913%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671913 not downloaded yet
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681969%27 HTTP/1.1" 200 None
2026-03-28 11:04:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681969 not downloaded yet
2026-03-28 11:04:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 98ba0866-113f-5795-bc05-eca7493443d3 with identifier: SD60%20AGX
2026-03-28 11:04:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 98ba0866-113f-5795-bc05-eca7493443d3 with identifier: SD60%20AGX
2026-03-28 11:04:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 98ba0866-113f-5795-bc05-eca7493443d3 with identifier: SD60%20AGX to the API
2026-03-28 11:04:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793141/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_expert_report_file_c998841c-d405-41c5-a741-bf1f382cb684.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD60%20AGX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '98ba0866-113f-5795-bc05-eca7493443d3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD60 AGX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD60%20AGX&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 121562,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793117/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54551,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793121/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793130/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793134/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95037,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77996,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793167/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_98ba0866-113f-5795-bc05-eca7493443d3/98ba0866-113f-5795-bc05-eca7493443d3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60AGX/698793174/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI ACENTA Hatchback',
'transmission': 'manual',
'trim': 'DCI ACENTA',
'vin': 'SJNFCAJ10U2143346',
'year': 2010}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520AGX%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [bca.uk] INFO: Saving data for SD60%20AGX: {'created_time': 1774695869.052694, 'last_price_update_time': 1774695869.052705, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD60%2520AGX') HTTP/1.1" 204 0
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ce990>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_expert_report_file_0012e0c0-cd5f-4591-9564-7ccc9bf747ab.pdf HTTP/1.1" 201 0
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aff89ad0-223a-54fe-8e4c-204722785203, skipping ID generation
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGK61NMX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK61NMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e553590>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_expert_report_file_2049f0c6-2bf3-4252-a17e-7f1fe235586a.pdf HTTP/1.1" 201 0
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14052306-8add-5dde-a7d4-036fc08c64dc, skipping ID generation
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF51EOS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF51EOS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671781>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671756/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671756>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671486/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671486>
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682161%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682161 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671616%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671616 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671932%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671932 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681988%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681988 not downloaded yet
2026-03-28 11:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671422%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671422 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681945%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681945 not downloaded yet
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682097/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682097>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671520>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671812>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK16BTV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682180%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682180 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671637%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671637 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671956%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671956 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682010%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682010 not downloaded yet
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e605c90>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_expert_report_file_66b0425a-4dc1-4792-919e-038e9ed1a3db.pdf HTTP/1.1" 201 0
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9b1ec82-00f3-5794-b089-4c8559efc82f, skipping ID generation
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGN63YUK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GN63YUK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe28590>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_expert_report_file_d06a1447-d117-4423-8b19-8044e9e20aee.pdf HTTP/1.1" 201 0
2026-03-28 11:04:29 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90ffee22-7433-5df0-ae47-99f4406a651d, skipping ID generation
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYR63WBM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YR63WBM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e289390>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483613%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483613/600 saved to cache
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc5050>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698681951%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681951/600 saved to cache
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3f810>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483599%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483599/600 saved to cache
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e257710>
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698768022%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768022/600 saved to cache
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671458%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671458 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681960%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681960 not downloaded yet
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681937/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681937>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682126>
2026-03-28 11:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682045%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682045 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681959%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681959 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681946%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681946 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671484%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671484 not downloaded yet
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681984%27 HTTP/1.1" 200 None
2026-03-28 11:04:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681984 not downloaded yet
2026-03-28 11:04:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671848/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671848>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671888>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681952/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681952>
2026-03-28 11:04:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682166>
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682068%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682068 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681983%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681983 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681958%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681958 not downloaded yet
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671756/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671510%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671510 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681999%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681999 not downloaded yet
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb00890>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698768003%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768003/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671486/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682096%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682096 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682005%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682005 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681978%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681978 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671535%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671535 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682018%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682018 not downloaded yet
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e851ed0>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682003%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682003/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682124%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682124 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682028%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682028 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698681995%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681995 not downloaded yet
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681988>
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671563%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671563 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682042%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682042 not downloaded yet
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681937/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682097/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682056%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682056 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682014%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682014 not downloaded yet
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae458f50>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682020%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682020/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea6350>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671756%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671756/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb01a10>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671486%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671486/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e613250>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671781%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671781/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YR63WBM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671583%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671583 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682067%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682067 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682084%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682084 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682047%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682047 not downloaded yet
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671603%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671603 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682100%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682100 not downloaded yet
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb76d50>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698681931%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681931/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc89c50>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671520%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671520/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ab610>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671812%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671812/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8aa710>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698681937%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681937/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e33b890>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682126%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682126/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff9f0d0>
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682097%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682097/600 saved to cache
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681952/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671848/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681984>
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671484>
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681999/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681999>
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682112%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682112 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682076%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682076 not downloaded yet
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671510>
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698671636%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671636 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682125%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682125 not downloaded yet
2026-03-28 11:04:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682147%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682147 not downloaded yet
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682105%27 HTTP/1.1" 200 None
2026-03-28 11:04:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682105 not downloaded yet
2026-03-28 11:04:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681978>
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682170%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682170 not downloaded yet
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698682128%27 HTTP/1.1" 200 None
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682128 not downloaded yet
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c36d0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682166%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682166/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682018>
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c33d0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698681952%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681952/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb12d0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671848%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671848/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682124/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682124>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681995>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671535>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682028>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682067>
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdb3950>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671888%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671888/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcd79d0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698681988%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681988/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2cf50>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698681933%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681933/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681999/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671603>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682076>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682100>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682128/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682128>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682170/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682170>
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7ed50>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698681999%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681999/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea49b10>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671510%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671510/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682124/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682105>
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682147/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682147>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff69190>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671484%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671484/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c7390>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698681984%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681984/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf9e90>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698682018%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682018/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671636>
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682170/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e239c50>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698682067%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682067/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e411c90>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682028%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682028/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdbf310>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671535%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671535/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf5e10>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698681995%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681995/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdbf5d0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698682124%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682124/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb21d0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698681978%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681978/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682128/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682125/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682125>
2026-03-28 11:04:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682112>
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d9ed0>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671603%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671603/600 saved to cache
2026-03-28 11:04:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff5e290>
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698682076%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682076/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4f5010>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698682100%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682100/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fccb290>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682170%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682170/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682084/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682084>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671583/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671583>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682047>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682042/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682042>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682056/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682056>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682014>
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682147/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50e710>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698682128%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682128/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671563>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682096>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681958/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681958>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682005>
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682125/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681983/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681983>
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb9ba10>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682147%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682147/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe29310>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698682105%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682105/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682056/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671583/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682042/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e850110>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682112%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682112/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d33d0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698682125%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682125/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681958/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681946>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682068/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682068>
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682084/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa99d0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671636%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671636/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feeeed0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682056%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682056/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681983/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682010>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682045/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682045>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681959>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681960/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681960>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671956/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671956>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671458>
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea17b10>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671583%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671583/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb98850>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698682042%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682042/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GN63YUK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682068/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671637>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671422/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671422>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681945>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671932>
2026-03-28 11:04:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682180>
2026-03-28 11:04:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YR63WBM/42809717?sv=2020-08-04&st=2026-03-28T11%3A04%3A25Z&se=2026-03-28T11%3A29%3A25Z&sr=b&sp=r&sig=jJovZ4Lipp%2F1bztXPbpFkQpiA1p5CxkoW%2BABxxaYzeY%3D)
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f58d0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698682047%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682047/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d24d0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698682014%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682014/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f6810>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698681958%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681958/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e3809d0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682005%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682005/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e33afd0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698682084%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682084/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc88d50>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698682096%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682096/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e380fd0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671563%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671563/600 saved to cache
2026-03-28 11:04:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc885d0>
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698681983%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681983/600 saved to cache
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671616>
2026-03-28 11:04:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e838d50>
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698682068%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682068/600 saved to cache
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6da10>
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYR63WBM%252F698681946%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681946/600 saved to cache
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 90ffee22-7433-5df0-ae47-99f4406a651d
2026-03-28 11:04:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 90ffee22-7433-5df0-ae47-99f4406a651d, skipping ID generation
2026-03-28 11:04:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 90ffee22-7433-5df0-ae47-99f4406a651d sending to next pipeline
2026-03-28 11:04:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 90ffee22-7433-5df0-ae47-99f4406a651d, identifier: YR63%20WBM
2026-03-28 11:04:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 90ffee22-7433-5df0-ae47-99f4406a651d with identifier: YR63%20WBM
2026-03-28 11:04:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 90ffee22-7433-5df0-ae47-99f4406a651d with identifier: YR63%20WBM
2026-03-28 11:04:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 90ffee22-7433-5df0-ae47-99f4406a651d with identifier: YR63%20WBM to the API
2026-03-28 11:04:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681946/600>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_expert_report_file_d06a1447-d117-4423-8b19-8044e9e20aee.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR63%20WBM-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '90ffee22-7433-5df0-ae47-99f4406a651d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR63 WBM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR63%20WBM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KUGA',
'odometer': 82829,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681958/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54393,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681978/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698681995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89302,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_90ffee22-7433-5df0-ae47-99f4406a651d/90ffee22-7433-5df0-ae47-99f4406a651d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YR63WBM/698682128/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM P/S StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM P/S',
'vin': 'WF0AXXWPMADC37227',
'year': 2013}
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR63%2520WBM%27 HTTP/1.1" 200 None
2026-03-28 11:04:34 [bca.uk] INFO: Saving data for YR63%20WBM: {'created_time': 1774695874.120868, 'last_price_update_time': 1774695874.120883, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR63%2520WBM') HTTP/1.1" 204 0
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681960/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682161/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682161>
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GN63YUK/42809718?sv=2020-08-04&st=2026-03-28T11%3A04%3A24Z&se=2026-03-28T11%3A29%3A24Z&sr=b&sp=r&sig=BN%2FlEt1TmSTLebzZFMswYqyLpktD6JK3Gfs9k3hVlIk%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682045/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671956/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF51EOS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671616/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671422/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff91dd0>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698682010%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682010/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4c490>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671458%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671458/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfb050>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698681960%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681960/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc8ab50>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698681941%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681941/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e4210>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGN63YUK%252F698681959%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681959/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9b1ec82-00f3-5794-b089-4c8559efc82f
2026-03-28 11:04:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9b1ec82-00f3-5794-b089-4c8559efc82f, skipping ID generation
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9b1ec82-00f3-5794-b089-4c8559efc82f sending to next pipeline
2026-03-28 11:04:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9b1ec82-00f3-5794-b089-4c8559efc82f, identifier: GN63%20YUK
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd114d0>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698682045%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682045/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8dfdd0>
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671956%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671956/600 saved to cache
2026-03-28 11:04:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GK61NMX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9b1ec82-00f3-5794-b089-4c8559efc82f with identifier: GN63%20YUK
2026-03-28 11:04:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9b1ec82-00f3-5794-b089-4c8559efc82f with identifier: GN63%20YUK
2026-03-28 11:04:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9b1ec82-00f3-5794-b089-4c8559efc82f with identifier: GN63%20YUK to the API
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681959/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_expert_report_file_66b0425a-4dc1-4792-919e-038e9ed1a3db.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN63%20YUK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9b1ec82-00f3-5794-b089-4c8559efc82f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN63 YUK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GN63%20YUK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'VENGA',
'odometer': 61938,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681959/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698681983/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53089,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54349,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682028/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682056/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682084/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682147/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b1ec82-00f3-5794-b089-4c8559efc82f/c9b1ec82-00f3-5794-b089-4c8559efc82f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GN63YUK/698682170/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'KIA VENGA 1.6 2 MPV',
'transmission': 'automatic',
'trim': '2',
'vin': 'U5YEH812MDL065948',
'year': 2013}
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520YUK%27 HTTP/1.1" 200 None
2026-03-28 11:04:35 [bca.uk] INFO: Saving data for GN63%20YUK: {'created_time': 1774695875.113337, 'last_price_update_time': 1774695875.113348, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GN63%2520YUK') HTTP/1.1" 204 0
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671913/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671913>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681969>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671589>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671565>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682103>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682135/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682135>
2026-03-28 11:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682161/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bc250>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671932%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671932/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdb1510>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698681945%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681945/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c4ed0>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671637%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671637/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea17f10>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682180%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682180/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d2cd0>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671616%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671616/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea17950>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671422%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671422/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF51EOS/42809602?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=IWDqiIN1TltxqashleHuJcJNL9U26QD5RhjVIs0jdyY%3D)
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682080/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682080>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671541>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682060/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682060>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682043/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682043>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682066/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682066>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671465/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671465>
2026-03-28 11:04:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682040/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682040>
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7fdd0>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682161%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682161/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac399d50>
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF51EOS%252F698681932%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681932/600 saved to cache
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 14052306-8add-5dde-a7d4-036fc08c64dc
2026-03-28 11:04:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 14052306-8add-5dde-a7d4-036fc08c64dc, skipping ID generation
2026-03-28 11:04:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 14052306-8add-5dde-a7d4-036fc08c64dc sending to next pipeline
2026-03-28 11:04:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 14052306-8add-5dde-a7d4-036fc08c64dc, identifier: MF51%20EOS
2026-03-28 11:04:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 14052306-8add-5dde-a7d4-036fc08c64dc with identifier: MF51%20EOS
2026-03-28 11:04:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 14052306-8add-5dde-a7d4-036fc08c64dc with identifier: MF51%20EOS
2026-03-28 11:04:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 14052306-8add-5dde-a7d4-036fc08c64dc with identifier: MF51%20EOS to the API
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681932/600>
{'auction_title': '',
'c_o_2_emission_value': 226,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_expert_report_file_2049f0c6-2bf3-4252-a17e-7f1fe235586a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF51%20EOS-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '14052306-8add-5dde-a7d4-036fc08c64dc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF51 EOS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF51%20EOS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'AUDI',
'model': 'TT',
'odometer': 84535,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54484,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681932/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51852,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681960/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51774,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698681999/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682018/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79498,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682042/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52445,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_14052306-8add-5dde-a7d4-036fc08c64dc/14052306-8add-5dde-a7d4-036fc08c64dc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71272,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF51EOS/698682125/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2001-01-01',
'seller_name': None,
'title': 'AUDI TT 1.8 T 225 QUATTRO Coupe',
'transmission': 'manual',
'trim': 'T 225 QUATTRO',
'vin': 'TRUZZZ8N821009095',
'year': 2001}
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF51%2520EOS%27 HTTP/1.1" 200 None
2026-03-28 11:04:36 [bca.uk] INFO: Saving data for MF51%20EOS: {'created_time': 1774695876.093922, 'last_price_update_time': 1774695876.093933, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF51%2520EOS') HTTP/1.1" 204 0
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16BTV/42809779?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=3tdFXW1T9Kw0GUFnMo7gkBeamQEoH%2B2NkIIMa3WzsZA%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GK61NMX/42809555?sv=2020-08-04&st=2026-03-28T11%3A04%3A23Z&se=2026-03-28T11%3A29%3A23Z&sr=b&sp=r&sig=0A27dn9s6tL0qNPjmWpRvYvHANaHmXDcjGsJvefTIdo%3D)
2026-03-28 11:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682023>
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682135/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671913/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671727>
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671465/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682080/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff7c8d0>
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16BTV%252F698681969%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681969/600 saved to cache
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699
2026-03-28 11:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699, skipping ID generation
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 sending to next pipeline
2026-03-28 11:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699, identifier: VK16%20BTV
2026-03-28 11:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV
2026-03-28 11:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV
2026-03-28 11:04:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5d7fb4f2-1282-50fc-900d-19b3eb0f2699 with identifier: VK16%20BTV to the API
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681969/600>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_expert_report_file_7525c8f6-8bcd-424b-a835-d6cb6a103f29.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK16%20BTV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.7L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5d7fb4f2-1282-50fc-900d-19b3eb0f2699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK16 BTV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK16%20BTV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'ALFA ROMEO',
'model': 'GIULIETTA',
'odometer': 123106,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49873,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681937/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681952/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698681988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682045/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64519,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682068/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81179,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5d7fb4f2-1282-50fc-900d-19b3eb0f2699/5d7fb4f2-1282-50fc-900d-19b3eb0f2699_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85552,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16BTV/698682124/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIETTA 1.7 TBI QUADRIFOGLIA VERDE TCT Hatchback',
'transmission': 'automatic',
'trim': 'TBI QUADRIFOGLIA VERDE TCT',
'vin': 'ZAR94000007420817',
'year': 2016}
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520BTV%27 HTTP/1.1" 200 None
2026-03-28 11:04:36 [bca.uk] INFO: Saving data for VK16%20BTV: {'created_time': 1774695876.785098, 'last_price_update_time': 1774695876.78511, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK16%2520BTV') HTTP/1.1" 204 0
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682040/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682060/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682043/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671437/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698671437>
2026-03-28 11:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682000/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698682000>
2026-03-28 11:04:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RX18LZV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea5110>
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGK61NMX%252F698671396%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671396/600 saved to cache
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item aff89ad0-223a-54fe-8e4c-204722785203
2026-03-28 11:04:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: aff89ad0-223a-54fe-8e4c-204722785203, skipping ID generation
2026-03-28 11:04:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item aff89ad0-223a-54fe-8e4c-204722785203 sending to next pipeline
2026-03-28 11:04:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: aff89ad0-223a-54fe-8e4c-204722785203, identifier: GK61%20NMX
2026-03-28 11:04:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682066/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX
2026-03-28 11:04:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX
2026-03-28 11:04:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: aff89ad0-223a-54fe-8e4c-204722785203 with identifier: GK61%20NMX to the API
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671396/600>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_expert_report_file_0012e0c0-cd5f-4591-9564-7ccc9bf747ab.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GK61%20NMX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'aff89ad0-223a-54fe-8e4c-204722785203',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GK61 NMX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GK61%20NMX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'CITROEN',
'model': 'C3',
'odometer': 126960,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53844,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671422/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52811,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671458/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671583/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_aff89ad0-223a-54fe-8e4c-204722785203/aff89ad0-223a-54fe-8e4c-204722785203_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GK61NMX/698671636/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 E-HDI A/D EXCLUSIVE Hatchback',
'transmission': 'manual',
'trim': 'E-HDI A/D EXCLUSIVE',
'vin': 'VF7SC9HPKBA582671',
'year': 2011}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK61%2520NMX%27 HTTP/1.1" 200 None
2026-03-28 11:04:37 [bca.uk] INFO: Saving data for GK61%20NMX: {'created_time': 1774695877.369926, 'last_price_update_time': 1774695877.369938, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GK61%2520NMX') HTTP/1.1" 204 0
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac25f8d0>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682135%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682135/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd1910>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671589%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671589/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe5d1d0>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671565%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671565/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e518c50>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682103%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682103/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb01910>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671913%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671913/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac25d810>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671465%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671465/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea6150>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682080%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682080/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac25e410>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671541%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671541/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483572>
2026-03-28 11:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802150>
2026-03-28 11:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681963>
2026-03-28 11:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698681982>
2026-03-28 11:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GR21HBF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698681975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EU19RWF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e33afd0>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682040%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682040/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d9690>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682060%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682060/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d88d0>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682043%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682043/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97c610>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682023%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682023/600 saved to cache
2026-03-28 11:04:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d9290>
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698682066%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682066/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RX18LZV/42808325?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=TolTwr%2F%2FW2pUJ9HwosnBQE7Ye1khewyQNgRKyaxrhQg%3D)
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682000/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671437/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767975>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e420750>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671727%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671727/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483535>
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV59%20TZE-GB>
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587930>
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL12%20MFA-GB>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec0090>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRX18LZV%252F698671705%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671705/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc
2026-03-28 11:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc, skipping ID generation
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bf8b4340-d9cb-5e9c-afb1-6c67c19048fc sending to next pipeline
2026-03-28 11:04:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc, identifier: RX18%20LZV
2026-03-28 11:04:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc with identifier: RX18%20LZV
2026-03-28 11:04:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc with identifier: RX18%20LZV
2026-03-28 11:04:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bf8b4340-d9cb-5e9c-afb1-6c67c19048fc with identifier: RX18%20LZV to the API
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671705/600>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_expert_report_file_7f6d2c67-c731-41ff-a266-cf28009f66df.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RX18%20LZV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'bf8b4340-d9cb-5e9c-afb1-6c67c19048fc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RX18 LZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RX18%20LZV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 69519,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671756/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671848/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75127,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671932/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bf8b4340-d9cb-5e9c-afb1-6c67c19048fc/bf8b4340-d9cb-5e9c-afb1-6c67c19048fc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RX18LZV/698671956/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 3.0 V6 D 260 PLATINUM ED.TIP.S Estate',
'transmission': 'manual',
'trim': 'V6 D 260 PLATINUM ED.TIP.S',
'vin': 'WP1ZZZ92ZJKA43766',
'year': 2018}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX18%2520LZV%27 HTTP/1.1" 200 None
2026-03-28 11:04:38 [bca.uk] INFO: Saving data for RX18%20LZV: {'created_time': 1774695878.690328, 'last_price_update_time': 1774695878.690342, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RX18%2520LZV') HTTP/1.1" 204 0
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698681975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EU19RWF/42809656?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=bFo4CNzRJeXphF1zhFnXw2kU%2F1Hbb6cdcAi5mGHPO4Q%3D)
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR21HBF/42808241?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=CWUnbbyB2gs%2FCrODzVgSLnzqXVGogU%2BPf%2Bs5UqyZFpU%3D)
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX70UBS/42809845?sv=2020-08-04&st=2026-03-28T11%3A04%3A21Z&se=2026-03-28T11%3A29%3A21Z&sr=b&sp=r&sig=q9mouTa%2B6chWB655QcOa1fdnenzRwxV2TOeAMtBZKXQ%3D)
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767939/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767939>
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483516>
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2784d0>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698682000%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682000/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a01d0>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671437%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671437/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813859/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813859>
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587879/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587879>
2026-03-28 11:04:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK58%20XAE-GB>
2026-03-28 11:04:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e420c50>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698681982%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681982/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebad1d0>
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEU19RWF%252F698681975%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698681975/600 saved to cache
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d110be31-ad93-5365-9ead-c1775f8e8e2b
2026-03-28 11:04:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d110be31-ad93-5365-9ead-c1775f8e8e2b, skipping ID generation
2026-03-28 11:04:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d110be31-ad93-5365-9ead-c1775f8e8e2b sending to next pipeline
2026-03-28 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d110be31-ad93-5365-9ead-c1775f8e8e2b, identifier: EU19%20RWF
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac278590>
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR21HBF%252F698671410%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671410/600 saved to cache
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24623035-d9ac-5881-a02b-df41247ee5f0
2026-03-28 11:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24623035-d9ac-5881-a02b-df41247ee5f0, skipping ID generation
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24623035-d9ac-5881-a02b-df41247ee5f0 sending to next pipeline
2026-03-28 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24623035-d9ac-5881-a02b-df41247ee5f0, identifier: GR21%20HBF
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd28fd0>
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802150%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802150/600 saved to cache
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e553e50>
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX70UBS%252F698681963%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681963/600 saved to cache
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e5a2781a-bf30-515d-96de-139303c8d44d
2026-03-28 11:04:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e5a2781a-bf30-515d-96de-139303c8d44d, skipping ID generation
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e5a2781a-bf30-515d-96de-139303c8d44d sending to next pipeline
2026-03-28 11:04:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e5a2781a-bf30-515d-96de-139303c8d44d, identifier: DX70%20UBS
2026-03-28 11:04:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e550e50>
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483572%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483572/600 saved to cache
2026-03-28 11:04:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d110be31-ad93-5365-9ead-c1775f8e8e2b with identifier: EU19%20RWF
2026-03-28 11:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d110be31-ad93-5365-9ead-c1775f8e8e2b with identifier: EU19%20RWF
2026-03-28 11:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d110be31-ad93-5365-9ead-c1775f8e8e2b with identifier: EU19%20RWF to the API
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698681975/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_expert_report_file_7b691d4c-1752-4993-99a0-09e19cd60947.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EU19%20RWF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd110be31-ad93-5365-9ead-c1775f8e8e2b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EU19 RWF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EU19%20RWF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'X-TRAIL',
'odometer': 74333,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698681975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682000/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682043/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52656,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682060/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682080/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83768,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60911,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682135/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77721,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682161/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d110be31-ad93-5365-9ead-c1775f8e8e2b/d110be31-ad93-5365-9ead-c1775f8e8e2b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EU19RWF/698682180/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'NISSAN X-TRAIL 1.3 DIG-T TEKNA (5ST) DCT StationWagon',
'transmission': 'automatic',
'trim': 'DIG-T TEKNA (5ST) DCT',
'vin': 'JN1TGAT32U0001054',
'year': 2019}
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU19%2520RWF%27 HTTP/1.1" 200 None
2026-03-28 11:04:39 [bca.uk] INFO: Saving data for EU19%20RWF: {'created_time': 1774695879.69777, 'last_price_update_time': 1774695879.697783, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EU19%2520RWF') HTTP/1.1" 204 0
2026-03-28 11:04:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24623035-d9ac-5881-a02b-df41247ee5f0 with identifier: GR21%20HBF
2026-03-28 11:04:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24623035-d9ac-5881-a02b-df41247ee5f0 with identifier: GR21%20HBF
2026-03-28 11:04:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24623035-d9ac-5881-a02b-df41247ee5f0 with identifier: GR21%20HBF to the API
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671410/600>
{'auction_title': '',
'c_o_2_emission_value': 57,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_expert_report_file_0ca50938-ece5-4ea8-976e-176de1ddce27.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GR21%20HBF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '24623035-d9ac-5881-a02b-df41247ee5f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GR21 HBF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GR21%20HBF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 31165,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53618,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671437/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49168,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671465/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671486/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49417,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46381,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83656,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78764,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671616/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24623035-d9ac-5881-a02b-df41247ee5f0/24623035-d9ac-5881-a02b-df41247ee5f0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49602,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR21HBF/698671637/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 P400E PHEV R-DYNAMIC SE StationWagon',
'transmission': 'automatic',
'trim': 'P400E PHEV R-DYNAMIC SE',
'vin': 'SALYA2AY1MA319271',
'year': 2021}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR21%2520HBF%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [bca.uk] INFO: Saving data for GR21%20HBF: {'created_time': 1774695880.116541, 'last_price_update_time': 1774695880.116553, 'auction_closing_time': 1774951200.0}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GR21%2520HBF') HTTP/1.1" 204 0
2026-03-28 11:04:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e5a2781a-bf30-515d-96de-139303c8d44d with identifier: DX70%20UBS
2026-03-28 11:04:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e5a2781a-bf30-515d-96de-139303c8d44d with identifier: DX70%20UBS
2026-03-28 11:04:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e5a2781a-bf30-515d-96de-139303c8d44d with identifier: DX70%20UBS to the API
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681963/600>
{'auction_title': '',
'c_o_2_emission_value': 185,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_expert_report_file_ea0ceb54-79fb-4187-b5fd-9482b2ec83df.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX70%20UBS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e5a2781a-bf30-515d-96de-139303c8d44d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX70 UBS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX70%20UBS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MITSUBISHI',
'model': 'ECLIPSE CROSS',
'odometer': 60856,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57662,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681951/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54939,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54426,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698681982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55691,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682003/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682040/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682066/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682097/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e5a2781a-bf30-515d-96de-139303c8d44d/e5a2781a-bf30-515d-96de-139303c8d44d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80655,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX70UBS/698682166/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'MITSUBISHI ECLIPSE CROSS 1.5 DYNAMIC Hatchback',
'transmission': 'automatic',
'trim': 'DYNAMIC',
'vin': 'JMAXTGK1WLZ000811',
'year': 2020}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX70%2520UBS%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [bca.uk] INFO: Saving data for DX70%20UBS: {'created_time': 1774695880.5354, 'last_price_update_time': 1774695880.535412, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX70%2520UBS') HTTP/1.1" 204 0
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WG09CXU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587862>
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767919/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767919>
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483504/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698483504>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6cfd0>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698767975%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767975/600 saved to cache
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb2d90>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587930%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587930/600 saved to cache
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587879/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767939/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4e9050>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_expert_report_file_608ccbb3-7333-4195-a2f0-b028d438a4a9.pdf HTTP/1.1" 201 0
2026-03-28 11:04:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b031631-a56a-5376-a862-429861371028, skipping ID generation
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSL12MFA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL12MFA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813859/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802264%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802264 not downloaded yet
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd06990>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483535%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483535/600 saved to cache
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602712/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602712>
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802280%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802280 not downloaded yet
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb7e50>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_expert_report_file_2e01d304-27a3-4de1-a9d7-48d99f7d7398.pdf HTTP/1.1" 201 0
2026-03-28 11:04:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da76a034-6e28-5bd7-b8f2-defa33d294f8, skipping ID generation
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWV59TZE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV59TZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF62%20UBR-GB>
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767919/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813826>
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483504/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802300%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802300 not downloaded yet
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633698%27 HTTP/1.1" 200 None
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633698 not downloaded yet
2026-03-28 11:04:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feff590>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483516%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483516/600 saved to cache
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e289350>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587879%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587879/600 saved to cache
2026-03-28 11:04:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e610710>
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698767939%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767939/600 saved to cache
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c7050>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813859%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813859/600 saved to cache
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WG09CXU/42808210?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=ePSdZQBce73Q2vdChzWCOHeKk0hj3%2BFDF11y9KOuM1g%3D)
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802318%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802318 not downloaded yet
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633717%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633717 not downloaded yet
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YA73ESV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602689>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BW15UPM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587789>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587837>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ee690>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_expert_report_file_7a7fec55-03f5-48ea-911e-58175a6cd569.pdf HTTP/1.1" 201 0
2026-03-28 11:04:41 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c9a0811-ec68-5e10-a040-020fffd73e15, skipping ID generation
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPK58XAE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK58XAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802330%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802330 not downloaded yet
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633734%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633734 not downloaded yet
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DH66OBL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602615>
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568843%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568843 not downloaded yet
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802366%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802366 not downloaded yet
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633750%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633750 not downloaded yet
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97c190>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698767919%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767919/600 saved to cache
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e850e90>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483504%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483504/600 saved to cache
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e506590>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587862%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587862/600 saved to cache
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568862%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568862 not downloaded yet
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802264>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602553/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602553>
2026-03-28 11:04:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SL12MFA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602712/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802387%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802387 not downloaded yet
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633761%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633761 not downloaded yet
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf5010>
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWG09CXU%252F698802100%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802100/600 saved to cache
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8
2026-03-28 11:04:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8, skipping ID generation
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0cc4b4b9-d7fe-53dc-8f97-217895129ef8 sending to next pipeline
2026-03-28 11:04:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8, identifier: WG09%20CXU
2026-03-28 11:04:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568883%27 HTTP/1.1" 200 None
2026-03-28 11:04:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568883 not downloaded yet
2026-03-28 11:04:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8 with identifier: WG09%20CXU
2026-03-28 11:04:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8 with identifier: WG09%20CXU
2026-03-28 11:04:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0cc4b4b9-d7fe-53dc-8f97-217895129ef8 with identifier: WG09%20CXU to the API
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802100/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_expert_report_file_4c33048a-f5d8-4096-aca8-7c8a184a7b8e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WG09%20CXU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0cc4b4b9-d7fe-53dc-8f97-217895129ef8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WG09 CXU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WG09%20CXU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 70307,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52818,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802125/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802136/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52654,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802164/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50033,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802174/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83147,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0cc4b4b9-d7fe-53dc-8f97-217895129ef8/0cc4b4b9-d7fe-53dc-8f97-217895129ef8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WG09CXU/698802225/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 I Hatchback',
'transmission': 'manual',
'trim': 'I',
'vin': 'KNABA24429T790021',
'year': 2009}
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG09%2520CXU%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [bca.uk] INFO: Saving data for WG09%20CXU: {'created_time': 1774695882.052468, 'last_price_update_time': 1774695882.052479, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WG09%2520CXU') HTTP/1.1" 204 0
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802280>
2026-03-28 11:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WV59TZE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802410%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802410 not downloaded yet
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633779%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633779 not downloaded yet
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BW15UPM/42801000?sv=2020-08-04&st=2026-03-28T11%3A03%3A31Z&se=2026-03-28T11%3A28%3A31Z&sr=b&sp=r&sig=lDVQgBzq0EZ%2Fah72%2Fbbx2pCKJZC8hLcKEt4v%2BJqDIu8%3D)
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KX64WYR/42804017?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=TuPHIHKUnptqv%2BInQVm7rjJVYbkw0m8jd16NvKEwS%2Fk%3D)
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568897%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568897 not downloaded yet
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb83b50>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602712%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602712/600 saved to cache
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802431%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802431 not downloaded yet
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633796%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633796 not downloaded yet
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YA73ESV/42807467?sv=2020-08-04&st=2026-03-28T11%3A03%3A32Z&se=2026-03-28T11%3A28%3A32Z&sr=b&sp=r&sig=qLRuwQUuyVZn9rqFlBBGoPNAUcT9dsee1AWuAWJwSzk%3D)
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568915%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568915 not downloaded yet
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5353d0>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813826%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813826/600 saved to cache
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633812%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633812 not downloaded yet
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802247/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DH66OBL/42808403?sv=2020-08-04&st=2026-03-28T11%3A03%3A24Z&se=2026-03-28T11%3A28%3A24Z&sr=b&sp=r&sig=NZjZqDncsgbv0Qpb173geWTE5amfIizTs68%2BxE5p6UQ%3D)
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602553/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:04:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633698/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633698>
2026-03-28 11:04:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568939%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568939 not downloaded yet
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698633824%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633824 not downloaded yet
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4c510>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_expert_report_file_406b4e26-e074-414c-b711-7617bba8932d.pdf HTTP/1.1" 201 0
2026-03-28 11:04:42 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebdf7fcb-6f78-5a9f-b674-658db260f8d9, skipping ID generation
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGF62UBR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF62UBR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae46fcd0>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBW15UPM%252F698483482%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483482/600 saved to cache
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743
2026-03-28 11:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743, skipping ID generation
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 sending to next pipeline
2026-03-28 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743, identifier: BW15%20UPM
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2fa10>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587789%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587789/600 saved to cache
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e846990>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKX64WYR%252F698587837%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587837/600 saved to cache
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f4eccf9d-8001-5d5e-9db1-5dec162636ac
2026-03-28 11:04:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f4eccf9d-8001-5d5e-9db1-5dec162636ac, skipping ID generation
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f4eccf9d-8001-5d5e-9db1-5dec162636ac sending to next pipeline
2026-03-28 11:04:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f4eccf9d-8001-5d5e-9db1-5dec162636ac, identifier: KX64%20WYR
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e85e8d0>
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602689%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602689/600 saved to cache
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568985%27 HTTP/1.1" 200 None
2026-03-28 11:04:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568985 not downloaded yet
2026-03-28 11:04:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM
2026-03-28 11:04:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM
2026-03-28 11:04:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 21fc7e7c-0aba-5544-8c1a-bc9132a1e743 with identifier: BW15%20UPM to the API
2026-03-28 11:04:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483482/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_expert_report_file_c59d4f42-ace8-4270-94ef-126704094ef9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BW15%20UPM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '21fc7e7c-0aba-5544-8c1a-bc9132a1e743',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BW15 UPM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BW15%20UPM&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'BMW',
'model': '218D',
'odometer': 99481,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48985,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48612,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483504/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483525/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77971,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483613/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_21fc7e7c-0aba-5544-8c1a-bc9132a1e743/21fc7e7c-0aba-5544-8c1a-bc9132a1e743_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76180,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BW15UPM/698483628/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'BMW 218D 2.0 M SPORT Coupe',
'transmission': 'manual',
'trim': 'M SPORT',
'vin': 'WBA1H32070V352391',
'year': 2015}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520UPM%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [bca.uk] INFO: Saving data for BW15%20UPM: {'created_time': 1774695883.223222, 'last_price_update_time': 1774695883.223232, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BW15%2520UPM') HTTP/1.1" 204 0
2026-03-28 11:04:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f4eccf9d-8001-5d5e-9db1-5dec162636ac with identifier: KX64%20WYR
2026-03-28 11:04:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f4eccf9d-8001-5d5e-9db1-5dec162636ac with identifier: KX64%20WYR
2026-03-28 11:04:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f4eccf9d-8001-5d5e-9db1-5dec162636ac with identifier: KX64%20WYR to the API
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587837/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_expert_report_file_82313c16-684c-461c-9356-f6a579e96cad.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KX64%20WYR-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f4eccf9d-8001-5d5e-9db1-5dec162636ac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KX64 WYR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KX64%20WYR&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FIAT',
'model': '500',
'odometer': 46675,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49271,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48057,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84824,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587879/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587905/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f4eccf9d-8001-5d5e-9db1-5dec162636ac/f4eccf9d-8001-5d5e-9db1-5dec162636ac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72032,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KX64WYR/698587930/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 CULT Hatchback',
'transmission': 'manual',
'trim': 'CULT',
'vin': 'ZFA3120000J281369',
'year': 2014}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX64%2520WYR%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [bca.uk] INFO: Saving data for KX64%20WYR: {'created_time': 1774695883.611761, 'last_price_update_time': 1774695883.611771, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KX64%2520WYR') HTTP/1.1" 204 0
2026-03-28 11:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633750>
2026-03-28 11:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568862>
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529606%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529606 not downloaded yet
2026-03-28 11:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633761/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633761>
2026-03-28 11:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802366/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802366>
2026-03-28 11:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568883/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568883>
2026-03-28 11:04:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802387>
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698569015%27 HTTP/1.1" 200 None
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569015 not downloaded yet
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e553850>
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYA73ESV%252F698767906%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767906/600 saved to cache
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2f74880c-6ef9-55be-9bdc-29c614fe9321
2026-03-28 11:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2f74880c-6ef9-55be-9bdc-29c614fe9321, skipping ID generation
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2f74880c-6ef9-55be-9bdc-29c614fe9321 sending to next pipeline
2026-03-28 11:04:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2f74880c-6ef9-55be-9bdc-29c614fe9321, identifier: YA73%20ESV
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3be290>
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802247%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802247/600 saved to cache
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e539810>
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602615%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602615/600 saved to cache
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe29a90>
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDH66OBL%252F698813686%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813686/600 saved to cache
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item cb019db5-f305-538c-b142-6039ad8ff322
2026-03-28 11:04:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cb019db5-f305-538c-b142-6039ad8ff322, skipping ID generation
2026-03-28 11:04:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cb019db5-f305-538c-b142-6039ad8ff322 sending to next pipeline
2026-03-28 11:04:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cb019db5-f305-538c-b142-6039ad8ff322, identifier: DH66%20OBL
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feaa3d0>
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602553%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602553/600 saved to cache
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc8f10>
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802264%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802264/600 saved to cache
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529616%27 HTTP/1.1" 200 None
2026-03-28 11:04:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529616 not downloaded yet
2026-03-28 11:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2f74880c-6ef9-55be-9bdc-29c614fe9321 with identifier: YA73%20ESV
2026-03-28 11:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2f74880c-6ef9-55be-9bdc-29c614fe9321 with identifier: YA73%20ESV
2026-03-28 11:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2f74880c-6ef9-55be-9bdc-29c614fe9321 with identifier: YA73%20ESV to the API
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767906/600>
{'auction_title': '',
'c_o_2_emission_value': 166,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_expert_report_file_c5498ed1-a431-43eb-8101-6721c5f401c0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YA73%20ESV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2f74880c-6ef9-55be-9bdc-29c614fe9321',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YA73 ESV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YA73%20ESV&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'BMW',
'model': 'M235I GRANCOUPE',
'odometer': 14217,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47803,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767919/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767939/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42947,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698767982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89945,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768003/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768022/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768037/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2f74880c-6ef9-55be-9bdc-29c614fe9321/2f74880c-6ef9-55be-9bdc-29c614fe9321_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YA73ESV/698768051/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'BMW M235I GRANCOUPE 2.0 XDRIVE STEP Coupe',
'transmission': 'automatic',
'trim': 'XDRIVE STEP',
'vin': 'WBA12AL0007N56622',
'year': 2023}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA73%2520ESV%27 HTTP/1.1" 200 None
2026-03-28 11:04:44 [bca.uk] INFO: Saving data for YA73%20ESV: {'created_time': 1774695884.58497, 'last_price_update_time': 1774695884.584983, 'auction_closing_time': 1774951200.0}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YA73%2520ESV') HTTP/1.1" 204 0
2026-03-28 11:04:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cb019db5-f305-538c-b142-6039ad8ff322 with identifier: DH66%20OBL
2026-03-28 11:04:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cb019db5-f305-538c-b142-6039ad8ff322 with identifier: DH66%20OBL
2026-03-28 11:04:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cb019db5-f305-538c-b142-6039ad8ff322 with identifier: DH66%20OBL to the API
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813686/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_expert_report_file_d6eb9230-fd10-4477-9a1e-ee01f516b2bc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DH66%20OBL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cb019db5-f305-538c-b142-6039ad8ff322',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DH66 OBL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DH66%20OBL&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 47259,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813751/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46382,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813768/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65870,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813859/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cb019db5-f305-538c-b142-6039ad8ff322/cb019db5-f305-538c-b142-6039ad8ff322_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78937,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DH66OBL/698813884/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I DESIGN Hatchback',
'transmission': 'manual',
'trim': 'VVT-I DESIGN',
'vin': 'VNKKJ3D340A399301',
'year': 2017}
2026-03-28 11:04:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DH66%2520OBL%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [bca.uk] INFO: Saving data for DH66%20OBL: {'created_time': 1774695885.000895, 'last_price_update_time': 1774695885.000906, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DH66%2520OBL') HTTP/1.1" 204 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698569055%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569055 not downloaded yet
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633812>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802431/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802431>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568897/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568897>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568915/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568915>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802410>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633779/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633779>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633796>
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633698/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529632%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529632 not downloaded yet
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8dec10>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802280%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802280/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac27b690>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633685%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633685/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529643%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529643 not downloaded yet
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529661%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529661 not downloaded yet
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529677%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529677 not downloaded yet
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaef450>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633698%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633698/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529595/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GF62UBR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568985/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568985>
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529692%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529692 not downloaded yet
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802366/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568883/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633761/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529705%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529705 not downloaded yet
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698529720%27 HTTP/1.1" 200 None
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529720 not downloaded yet
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568915/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568897/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb0cc10>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568862%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568862/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529616/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529616>
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802431/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633779/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09c990>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802366%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802366/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e606b10>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802387%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802387/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1b3d0>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568883%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568883/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e423d90>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633750%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633750/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe18f50>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633761%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633761/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529595/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529632>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529643>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529661/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529661>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529692>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529677>
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568985/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb05390>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568915%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568915/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07b10>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568897%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568897/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7b690>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802410%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802410/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb98b50>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633812%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633812/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7be90>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802431%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802431/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd05dd0>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633796%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633796/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfb610>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633779%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633779/600 saved to cache
2026-03-28 11:04:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529616/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569055>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569015>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529705/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529705>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633824>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529720/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529720>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698529606>
2026-03-28 11:04:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568939/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568939>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9e550>
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529595%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529595/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e511f50>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568985%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568985/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633734>
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529661/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568843>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802330/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802330>
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d2450>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529616%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529616/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529705/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568939/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feee610>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529661%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529661/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK58XAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802330/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc260d0>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529643%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529643/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fe6d0>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529632%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529632/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf4cd0>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529692%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529692/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb74990>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529677%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529677/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529720/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GF62UBR/42802355?sv=2020-08-04&st=2026-03-28T11%3A04%3A40Z&se=2026-03-28T11%3A29%3A40Z&sr=b&sp=r&sig=W9qbqGLh1Y8kWf8BWzeFmxeWJxAxwDF%2BZVGk8LqvETk%3D)
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698633717>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802300>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802318>
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3c8210>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698569015%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569015/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac40d7d0>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633824%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633824/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2ec50>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529705%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529705/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e33a750>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568939%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568939/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea279d0>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529606%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529606/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4c650>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633734%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633734/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2c990>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698569055%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569055/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ae250>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802330%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802330/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293602>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786805>
2026-03-28 11:04:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK58XAE/42803846?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=RoLgmXO9drJG%2BgSGyax3T4CIzF8rayBhApk4Zpmsk98%3D)
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602544/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WF61VPM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793639>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802044/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802044>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796888>
2026-03-28 11:04:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ58%20ZNU-GB>
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94aeef30d0>
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGF62UBR%252F698529720%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529720/600 saved to cache
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9
2026-03-28 11:04:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ebdf7fcb-6f78-5a9f-b674-658db260f8d9, skipping ID generation
2026-03-28 11:04:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ebdf7fcb-6f78-5a9f-b674-658db260f8d9 sending to next pipeline
2026-03-28 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ebdf7fcb-6f78-5a9f-b674-658db260f8d9, identifier: GF62%20UBR
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe78450>
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568843%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568843/600 saved to cache
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR
2026-03-28 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR
2026-03-28 11:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ebdf7fcb-6f78-5a9f-b674-658db260f8d9 with identifier: GF62%20UBR to the API
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529720/600>
{'auction_title': '',
'c_o_2_emission_value': 122,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_expert_report_file_406b4e26-e074-414c-b711-7617bba8932d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GF62%20UBR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ebdf7fcb-6f78-5a9f-b674-658db260f8d9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GF62 UBR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GF62%20UBR&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'BMW',
'model': '120D',
'odometer': 108267,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47923,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529595/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529616/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45237,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529661/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529677/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529705/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ebdf7fcb-6f78-5a9f-b674-658db260f8d9/ebdf7fcb-6f78-5a9f-b674-658db260f8d9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84191,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GF62UBR/698529720/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'BMW 120D 2.0 URBAN Hatchback',
'transmission': 'manual',
'trim': 'URBAN',
'vin': 'WBA1C32000J230395',
'year': 2012}
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF62%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 11:04:47 [bca.uk] INFO: Saving data for GF62%20UBR: {'created_time': 1774695887.558732, 'last_price_update_time': 1774695887.558746, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GF62%2520UBR') HTTP/1.1" 204 0
2026-03-28 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WV59TZE/42804863?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=NwgDGv8a%2FRUdrRo1IMVmqdewb4aL42y5%2FgYlRHJSZ4A%3D)
2026-03-28 11:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786780>
2026-03-28 11:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796847>
2026-03-28 11:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796593>
2026-03-28 11:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801975>
2026-03-28 11:04:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293596>
2026-03-28 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL12MFA/42808218?sv=2020-08-04&st=2026-03-28T11%3A04%3A38Z&se=2026-03-28T11%3A29%3A38Z&sr=b&sp=r&sig=V071qUkLXNLOt2Gu%2BWTmmJzyYtYslWS%2B7y%2BqscCTsb0%3D)
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09cf10>
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK58XAE%252F698568820%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568820/600 saved to cache
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8c9a0811-ec68-5e10-a040-020fffd73e15
2026-03-28 11:04:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8c9a0811-ec68-5e10-a040-020fffd73e15, skipping ID generation
2026-03-28 11:04:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8c9a0811-ec68-5e10-a040-020fffd73e15 sending to next pipeline
2026-03-28 11:04:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8c9a0811-ec68-5e10-a040-020fffd73e15, identifier: PK58%20XAE
2026-03-28 11:04:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE
2026-03-28 11:04:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE
2026-03-28 11:04:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8c9a0811-ec68-5e10-a040-020fffd73e15 with identifier: PK58%20XAE to the API
2026-03-28 11:04:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568820/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_expert_report_file_7a7fec55-03f5-48ea-911e-58175a6cd569.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK58%20XAE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8c9a0811-ec68-5e10-a040-020fffd73e15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK58 XAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK58%20XAE&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 119093,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47274,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44104,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44203,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568883/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568897/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43756,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568915/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568939/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698568985/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8c9a0811-ec68-5e10-a040-020fffd73e15/8c9a0811-ec68-5e10-a040-020fffd73e15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK58XAE/698569055/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TDCI ZETEC Hatchback',
'transmission': 'manual',
'trim': 'TDCI ZETEC',
'vin': 'WF0JXXGAJJ8Y20522',
'year': 2008}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK58%2520XAE%27 HTTP/1.1" 200 None
2026-03-28 11:04:48 [bca.uk] INFO: Saving data for PK58%20XAE: {'created_time': 1774695888.130456, 'last_price_update_time': 1774695888.130468, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK58%2520XAE') HTTP/1.1" 204 0
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602544/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF61VPM/42804553?sv=2020-08-04&st=2026-03-28T11%3A03%3A23Z&se=2026-03-28T11%3A28%3A23Z&sr=b&sp=r&sig=Y%2BWrLA841WmleWJf6d42pUCIIUB7em0SQlf5GZXNrC8%3D)
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:04:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775668>
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802044/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaee750>
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWV59TZE%252F698633717%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633717/600 saved to cache
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item da76a034-6e28-5bd7-b8f2-defa33d294f8
2026-03-28 11:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: da76a034-6e28-5bd7-b8f2-defa33d294f8, skipping ID generation
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item da76a034-6e28-5bd7-b8f2-defa33d294f8 sending to next pipeline
2026-03-28 11:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: da76a034-6e28-5bd7-b8f2-defa33d294f8, identifier: WV59%20TZE
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9abb50>
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802318%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802318/600 saved to cache
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe7a5d0>
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL12MFA%252F698802300%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802300/600 saved to cache
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4b031631-a56a-5376-a862-429861371028
2026-03-28 11:04:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4b031631-a56a-5376-a862-429861371028, skipping ID generation
2026-03-28 11:04:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4b031631-a56a-5376-a862-429861371028 sending to next pipeline
2026-03-28 11:04:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4b031631-a56a-5376-a862-429861371028, identifier: SL12%20MFA
2026-03-28 11:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: da76a034-6e28-5bd7-b8f2-defa33d294f8 with identifier: WV59%20TZE
2026-03-28 11:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: da76a034-6e28-5bd7-b8f2-defa33d294f8 with identifier: WV59%20TZE
2026-03-28 11:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: da76a034-6e28-5bd7-b8f2-defa33d294f8 with identifier: WV59%20TZE to the API
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633717/600>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_expert_report_file_2e01d304-27a3-4de1-a9d7-48d99f7d7398.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WV59%20TZE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'da76a034-6e28-5bd7-b8f2-defa33d294f8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WV59 TZE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WV59%20TZE&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MINI',
'model': 'COOPER',
'odometer': 96316,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633698/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50359,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47293,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633761/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91817,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633779/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76373,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_da76a034-6e28-5bd7-b8f2-defa33d294f8/da76a034-6e28-5bd7-b8f2-defa33d294f8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87901,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WV59TZE/698633824/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 GRAPHITE Hatchback',
'transmission': 'automatic',
'trim': 'GRAPHITE',
'vin': 'WMWMF32020TW26322',
'year': 2009}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV59%2520TZE%27 HTTP/1.1" 200 None
2026-03-28 11:04:48 [bca.uk] INFO: Saving data for WV59%20TZE: {'created_time': 1774695888.840237, 'last_price_update_time': 1774695888.840254, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WV59%2520TZE') HTTP/1.1" 204 0
2026-03-28 11:04:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4b031631-a56a-5376-a862-429861371028 with identifier: SL12%20MFA
2026-03-28 11:04:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4b031631-a56a-5376-a862-429861371028 with identifier: SL12%20MFA
2026-03-28 11:04:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4b031631-a56a-5376-a862-429861371028 with identifier: SL12%20MFA to the API
2026-03-28 11:04:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802300/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_expert_report_file_608ccbb3-7333-4195-a2f0-b028d438a4a9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL12%20MFA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4b031631-a56a-5376-a862-429861371028',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL12 MFA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL12%20MFA&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'SEAT',
'model': 'IBIZA ST',
'odometer': 148022,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802247/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46435,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802264/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802330/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802366/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70226,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4b031631-a56a-5376-a862-429861371028/4b031631-a56a-5376-a862-429861371028_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL12MFA/698802431/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'SEAT IBIZA ST 1.6 TDI CR SPORTRIDER Estate',
'transmission': 'manual',
'trim': 'TDI CR SPORTRIDER',
'vin': 'VSSZZZ6JZCR095326',
'year': 2012}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL12%2520MFA%27 HTTP/1.1" 200 None
2026-03-28 11:04:50 [bca.uk] INFO: Saving data for SL12%20MFA: {'created_time': 1774695890.186115, 'last_price_update_time': 1774695890.186126, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL12%2520MFA') HTTP/1.1" 204 0
2026-03-28 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796573>
2026-03-28 11:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793626>
2026-03-28 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebae2d0>
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF61VPM%252F698602544%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602544/600 saved to cache
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 28ab50ea-4f5a-545f-b49b-8b86322ed399
2026-03-28 11:04:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28ab50ea-4f5a-545f-b49b-8b86322ed399, skipping ID generation
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28ab50ea-4f5a-545f-b49b-8b86322ed399 sending to next pipeline
2026-03-28 11:04:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 28ab50ea-4f5a-545f-b49b-8b86322ed399, identifier: WF61%20VPM
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d2e90>
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793639%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793639/600 saved to cache
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e288210>
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786805%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786805/600 saved to cache
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50e450>
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293602%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293602/600 saved to cache
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e289550>
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796888%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796888/600 saved to cache
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e50e510>
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698802044%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802044/600 saved to cache
2026-03-28 11:04:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX13%20UKP-GB>
2026-03-28 11:04:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 28ab50ea-4f5a-545f-b49b-8b86322ed399 with identifier: WF61%20VPM
2026-03-28 11:04:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 28ab50ea-4f5a-545f-b49b-8b86322ed399 with identifier: WF61%20VPM
2026-03-28 11:04:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 28ab50ea-4f5a-545f-b49b-8b86322ed399 with identifier: WF61%20VPM to the API
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602544/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_expert_report_file_e19f2ae6-3516-4aa2-8932-412f31da8c63.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF61%20VPM-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '28ab50ea-4f5a-545f-b49b-8b86322ed399',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF61 VPM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF61%20VPM&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FIAT',
'model': 'PANDA',
'odometer': 27371,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602553/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602580/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47511,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48388,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602670/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81894,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28ab50ea-4f5a-545f-b49b-8b86322ed399/28ab50ea-4f5a-545f-b49b-8b86322ed399_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF61VPM/698602712/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'FIAT PANDA 1.2 (69) ACTIVE Hatchback',
'transmission': 'manual',
'trim': '(69) ACTIVE',
'vin': 'ZFA16900004004835',
'year': 2011}
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520VPM%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [bca.uk] INFO: Saving data for WF61%20VPM: {'created_time': 1774695891.046753, 'last_price_update_time': 1774695891.046764, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF61%2520VPM') HTTP/1.1" 204 0
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a8650>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_expert_report_file_eed14c22-58c0-4220-a880-aa21928f3ac8.pdf HTTP/1.1" 201 0
2026-03-28 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe, skipping ID generation
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWJ58ZNU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ58ZNU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293565/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698293565>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786763/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786763>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796824>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801957>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775643>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM18%20ZYB-GB>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaee990>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786780%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786780/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7e810>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293596%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293596/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7e6d0>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698801975%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801975/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd073d0>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796847%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796847/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07f90>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796593%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796593/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793615>
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568825%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568825 not downloaded yet
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568849%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568849 not downloaded yet
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568874%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568874 not downloaded yet
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568889%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568889 not downloaded yet
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ10LNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796562>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP65NNV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568906%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568906 not downloaded yet
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796551>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801939/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801939>
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568940%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568940 not downloaded yet
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698568976%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568976 not downloaded yet
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e550910>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775668%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775668/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698569018%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569018 not downloaded yet
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698569052%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569052 not downloaded yet
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd12710>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793626%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793626/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786763/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568805/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WJ58ZNU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293565/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP65NNV/42797672?sv=2020-08-04&st=2026-03-28T11%3A03%3A07Z&se=2026-03-28T11%3A28%3A07Z&sr=b&sp=r&sig=9DCGuu2QkaiIB9vlFFsv2ulloHf0zSTWAEK8gCIBsC8%3D)
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8db7d0>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698801957%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801957/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea15a90>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796573%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796573/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801939/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568976>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568940>
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568906>
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e51bcd0>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775643%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775643/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3984d0>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796824%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796824/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ10LNA/42807776?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=7KCH1vgo9nFvhVpnffgPr0ElX25SEmNyX%2F53%2FFaLXl4%3D)
2026-03-28 11:04:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568889>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5db790>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_expert_report_file_796654c5-67e3-4261-ad01-8a90c18a3cb8.pdf HTTP/1.1" 201 0
2026-03-28 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3355af6-f641-5eb5-8dc1-8e17df374efc, skipping ID generation
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM18ZYB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM18ZYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e51a110>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786763%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786763/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd11350>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293565%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293565/600 saved to cache
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e513c50>
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_expert_report_file_c0ff2253-2f6f-4284-a1ba-51a2c3ecace9.pdf HTTP/1.1" 201 0
2026-03-28 11:04:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44, skipping ID generation
2026-03-28 11:04:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEX13UKP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EX13UKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf66d0>
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP65NNV%252F698293560%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293560/600 saved to cache
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item baefc678-d212-5082-a8e0-52e336dc5403
2026-03-28 11:04:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: baefc678-d212-5082-a8e0-52e336dc5403, skipping ID generation
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item baefc678-d212-5082-a8e0-52e336dc5403 sending to next pipeline
2026-03-28 11:04:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: baefc678-d212-5082-a8e0-52e336dc5403, identifier: KP65%20NNV
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd1750>
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793615%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793615/600 saved to cache
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7d490>
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796562%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796562/600 saved to cache
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: baefc678-d212-5082-a8e0-52e336dc5403 with identifier: KP65%20NNV
2026-03-28 11:04:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: baefc678-d212-5082-a8e0-52e336dc5403 with identifier: KP65%20NNV
2026-03-28 11:04:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: baefc678-d212-5082-a8e0-52e336dc5403 with identifier: KP65%20NNV to the API
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293560/600>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_expert_report_file_a738562c-6f59-4482-9e58-1d13524aa677.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP65%20NNV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'baefc678-d212-5082-a8e0-52e336dc5403',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP65 NNV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP65%20NNV&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 106020,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293565/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43927,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43063,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293604/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_baefc678-d212-5082-a8e0-52e336dc5403/baefc678-d212-5082-a8e0-52e336dc5403_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP65NNV/698293624/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 SE DCT Hatchback',
'transmission': 'automatic',
'trim': 'SE DCT',
'vin': 'WDD1760122V110700',
'year': 2015}
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520NNV%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [bca.uk] INFO: Saving data for KP65%20NNV: {'created_time': 1774695892.808221, 'last_price_update_time': 1774695892.808235, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP65%2520NNV') HTTP/1.1" 204 0
2026-03-28 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568805/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569018/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569018>
2026-03-28 11:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568874>
2026-03-28 11:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569052/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698569052>
2026-03-28 11:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568825>
2026-03-28 11:04:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568849/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698568849>
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602609%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602609 not downloaded yet
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782563%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782563 not downloaded yet
2026-03-28 11:04:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775607>
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602622%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602622 not downloaded yet
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782567%27 HTTP/1.1" 200 None
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782567 not downloaded yet
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e381490>
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698801939%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801939/600 saved to cache
2026-03-28 11:04:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff9dc10>
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ10LNA%252F698786754%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786754/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c46ed1ba-1db0-5976-a700-17645579f4fb
2026-03-28 11:04:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c46ed1ba-1db0-5976-a700-17645579f4fb, skipping ID generation
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c46ed1ba-1db0-5976-a700-17645579f4fb sending to next pipeline
2026-03-28 11:04:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c46ed1ba-1db0-5976-a700-17645579f4fb, identifier: NJ10%20LNA
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602642%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602642 not downloaded yet
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782572%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782572 not downloaded yet
2026-03-28 11:04:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c46ed1ba-1db0-5976-a700-17645579f4fb with identifier: NJ10%20LNA
2026-03-28 11:04:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c46ed1ba-1db0-5976-a700-17645579f4fb with identifier: NJ10%20LNA
2026-03-28 11:04:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c46ed1ba-1db0-5976-a700-17645579f4fb with identifier: NJ10%20LNA to the API
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786754/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_expert_report_file_46e32bd4-45f3-43f2-ad41-ac3259cb791c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ10%20LNA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c46ed1ba-1db0-5976-a700-17645579f4fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ10 LNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ10%20LNA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 91492,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786763/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42431,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42538,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786790/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43918,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42657,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82514,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76651,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c46ed1ba-1db0-5976-a700-17645579f4fb/c46ed1ba-1db0-5976-a700-17645579f4fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ10LNA/698786902/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.2 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'MALAM51CLAM525732',
'year': 2010}
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ10%2520LNA%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [bca.uk] INFO: Saving data for NJ10%20LNA: {'created_time': 1774695893.587846, 'last_price_update_time': 1774695893.587857, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ10%2520LNA') HTTP/1.1" 204 0
2026-03-28 11:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698793607>
2026-03-28 11:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796520>
2026-03-28 11:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801930>
2026-03-28 11:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796537>
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602656%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602656 not downloaded yet
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782577%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782577 not downloaded yet
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97e2d0>
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568805%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568805/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e847190>
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796551%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796551/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602669%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602669 not downloaded yet
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782588%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782588 not downloaded yet
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602688%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602688 not downloaded yet
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782596%27 HTTP/1.1" 200 None
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782596 not downloaded yet
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdbe890>
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568906%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568906/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39ab10>
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568889%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568889/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e543a10>
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568940%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568940/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb9b850>
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568976%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568976/600 saved to cache
2026-03-28 11:04:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568849/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM18ZYB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782558/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EX13UKP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602709%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602709 not downloaded yet
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782606%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782606 not downloaded yet
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569018/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569052/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WJ58ZNU/42803800?sv=2020-08-04&st=2026-03-28T11%3A04%3A46Z&se=2026-03-28T11%3A29%3A46Z&sr=b&sp=r&sig=zXr%2F0andLCIX%2BM6qvuwFH8CSCMI2oMGkuOLO0U%2BA7xc%3D)
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602727%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602727 not downloaded yet
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782613%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782613 not downloaded yet
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698602750%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602750 not downloaded yet
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff5e710>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568849%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568849/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782567>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602642/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602642>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782572>
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7a4d0>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568825%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568825/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d9350>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698568874%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568874/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602622>
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09cad0>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698569018%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569018/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea4af50>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWJ58ZNU%252F698569052%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569052/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe
2026-03-28 11:04:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe, skipping ID generation
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe sending to next pipeline
2026-03-28 11:04:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe, identifier: WJ58%20ZNU
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb76b90>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775607%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775607/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:04:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe with identifier: WJ58%20ZNU
2026-03-28 11:04:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe with identifier: WJ58%20ZNU
2026-03-28 11:04:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7d3e3d6c-8d83-568a-b2d6-6e7cec776efe with identifier: WJ58%20ZNU to the API
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569052/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_expert_report_file_eed14c22-58c0-4220-a880-aa21928f3ac8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WJ58%20ZNU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7d3e3d6c-8d83-568a-b2d6-6e7cec776efe',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WJ58 ZNU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WJ58%20ZNU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'TOYOTA',
'model': 'AYGO',
'odometer': 59469,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568805/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51538,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568849/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50885,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74392,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698568976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90024,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569018/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7d3e3d6c-8d83-568a-b2d6-6e7cec776efe/7d3e3d6c-8d83-568a-b2d6-6e7cec776efe_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79920,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WJ58ZNU/698569052/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'TOYOTA AYGO 1.0 VVT-I PLATINUM Hatchback',
'transmission': 'manual',
'trim': 'VVT-I PLATINUM',
'vin': 'JTDJG18C40N299774',
'year': 2008}
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ58%2520ZNU%27 HTTP/1.1" 200 None
2026-03-28 11:04:54 [bca.uk] INFO: Saving data for WJ58%20ZNU: {'created_time': 1774695894.910355, 'last_price_update_time': 1774695894.910369, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WJ58%2520ZNU') HTTP/1.1" 204 0
2026-03-28 11:04:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602688>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782588>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602669>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782596/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782596>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782577>
2026-03-28 11:04:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782606>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae46a410>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698801930%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801930/600 saved to cache
2026-03-28 11:04:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb779d0>
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796520%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796520/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e380190>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793607%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793607/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebaf6d0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796537%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796537/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782558/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e339310>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602593%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602593/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602727>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782613/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782613>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602750>
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602709>
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602642/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:04:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:04:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602656>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf8850>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782558%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782558/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782596/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac26c1d0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602622%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602622/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb061d0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602642%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602642/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfa0d0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782567%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782567/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782563>
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaef990>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782572%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782572/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb02490>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602669%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602669/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e239a10>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782577%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782577/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a8750>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782606%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782606/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2381d0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782596%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782596/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e238e50>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782588%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782588/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602609/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698602609>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775582>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SK18JKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782613/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb00910>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602688%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602688/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6c110>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602750%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602750/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796535>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801919/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801919>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775553/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775553>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796517/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796517>
2026-03-28 11:04:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM13%20DLO-GB>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e540950>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602656%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602656/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e538ad0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602727%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602727/600 saved to cache
2026-03-28 11:04:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4ddd0>
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:04:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602709%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602709/600 saved to cache
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4db810>
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782613%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782613/600 saved to cache
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SK18JKO/42807352?sv=2020-08-04&st=2026-03-28T11%3A03%3A05Z&se=2026-03-28T11%3A28%3A05Z&sr=b&sp=r&sig=CtRCI2GBbFcFqiU0LzhXiLP2PE7BA75L86SW67W4K7U%3D)
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802041>
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796533>
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602609/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM18ZYB/42804161?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=54A4WRpRt%2FwhY4OoVG8D4InlXjICpuz3hLi1Z5TaTS0%3D)
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY66%20UZM-GB>
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EX13UKP/42807746?sv=2020-08-04&st=2026-03-28T11%3A04%3A50Z&se=2026-03-28T11%3A29%3A50Z&sr=b&sp=r&sig=Tcn%2FPkxYn8mPHziJhN6NLzeEjI2H4w0DfmquFkES0q4%3D)
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR10UYM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD56WYJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775537/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775537>
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2e690>
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSK18JKO%252F698793599%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793599/600 saved to cache
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3f73c621-a26f-5e74-976e-c93fdd575bad
2026-03-28 11:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3f73c621-a26f-5e74-976e-c93fdd575bad, skipping ID generation
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3f73c621-a26f-5e74-976e-c93fdd575bad sending to next pipeline
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3f73c621-a26f-5e74-976e-c93fdd575bad, identifier: SK18%20JKO
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3f73c621-a26f-5e74-976e-c93fdd575bad with identifier: SK18%20JKO
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3f73c621-a26f-5e74-976e-c93fdd575bad with identifier: SK18%20JKO
2026-03-28 11:04:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3f73c621-a26f-5e74-976e-c93fdd575bad with identifier: SK18%20JKO to the API
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793599/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_expert_report_file_38e859e6-fc99-4793-8fd7-4c32e957672f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SK18%20JKO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3f73c621-a26f-5e74-976e-c93fdd575bad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SK18 JKO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SK18%20JKO&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'SSANGYONG',
'model': 'TIVOLI',
'odometer': 72045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44812,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793599/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45943,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793634/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88278,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793670/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3f73c621-a26f-5e74-976e-c93fdd575bad/3f73c621-a26f-5e74-976e-c93fdd575bad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89577,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SK18JKO/698793693/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'SSANGYONG TIVOLI 1.6 128 ELX 2WD Hatchback',
'transmission': 'manual',
'trim': '128 ELX 2WD',
'vin': 'KPT30B1VSHP145348',
'year': 2018}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK18%2520JKO%27 HTTP/1.1" 200 None
2026-03-28 11:04:56 [bca.uk] INFO: Saving data for SK18%20JKO: {'created_time': 1774695896.837333, 'last_price_update_time': 1774695896.837347, 'auction_closing_time': 1774864800.0}
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SK18%2520JKO') HTTP/1.1" 204 0
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801919/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775553/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796517/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LX64OPJ/42807953?sv=2020-08-04&st=2026-03-28T11%3A03%3A03Z&se=2026-03-28T11%3A28%3A03Z&sr=b&sp=r&sig=yrLykHNBm7JwOVX%2FogAiA7hfL1pxwcagPsFuudNjtA4%3D)
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e57a050>
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM18ZYB%252F698602609%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602609/600 saved to cache
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d3355af6-f641-5eb5-8dc1-8e17df374efc
2026-03-28 11:04:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d3355af6-f641-5eb5-8dc1-8e17df374efc, skipping ID generation
2026-03-28 11:04:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d3355af6-f641-5eb5-8dc1-8e17df374efc sending to next pipeline
2026-03-28 11:04:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d3355af6-f641-5eb5-8dc1-8e17df374efc, identifier: KM18%20ZYB
2026-03-28 11:04:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801966>
2026-03-28 11:04:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:04:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d3355af6-f641-5eb5-8dc1-8e17df374efc with identifier: KM18%20ZYB
2026-03-28 11:04:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d3355af6-f641-5eb5-8dc1-8e17df374efc with identifier: KM18%20ZYB
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d3355af6-f641-5eb5-8dc1-8e17df374efc with identifier: KM18%20ZYB to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602609/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_expert_report_file_796654c5-67e3-4261-ad01-8a90c18a3cb8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM18%20ZYB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd3355af6-f641-5eb5-8dc1-8e17df374efc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM18 ZYB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM18%20ZYB&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'MERCEDES-BENZ',
'model': 'GLC 250 D',
'odometer': 47721,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54219,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602609/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602642/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47680,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602688/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75337,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602709/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87065,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d3355af6-f641-5eb5-8dc1-8e17df374efc/d3355af6-f641-5eb5-8dc1-8e17df374efc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79542,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM18ZYB/698602750/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLC 250 D 2.1 AMG LINE 4M 9G StationWagon',
'transmission': 'manual',
'trim': 'AMG LINE 4M 9G',
'vin': 'WDC2539092F431913',
'year': 2018}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM18%2520ZYB%27 HTTP/1.1" 200 None
2026-03-28 11:04:57 [bca.uk] INFO: Saving data for KM18%20ZYB: {'created_time': 1774695897.401269, 'last_price_update_time': 1774695897.401283, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM18%2520ZYB') HTTP/1.1" 204 0
2026-03-28 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:57 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:57 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:57 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:57 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb0d610>
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775582%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775582/600 saved to cache
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdb1950>
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEX13UKP%252F698782563%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782563/600 saved to cache
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44
2026-03-28 11:04:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44, skipping ID generation
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2d929da9-18d2-5c95-bdec-e0ef0eec1e44 sending to next pipeline
2026-03-28 11:04:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44, identifier: EX13%20UKP
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea7010>
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796535%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796535/600 saved to cache
2026-03-28 11:04:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:04:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR10UYM/42807860?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=apO7LXClzVNLw%2B5hr2jYWU3oUv4WFspc39mzKMfWTxc%3D)
2026-03-28 11:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698801934>
2026-03-28 11:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP15%20OKE-GB>
2026-03-28 11:04:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA58FEF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:04:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44 with identifier: EX13%20UKP
2026-03-28 11:04:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44 with identifier: EX13%20UKP
2026-03-28 11:04:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2d929da9-18d2-5c95-bdec-e0ef0eec1e44 with identifier: EX13%20UKP to the API
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782563/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_expert_report_file_c0ff2253-2f6f-4284-a1ba-51a2c3ecace9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EX13%20UKP-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2d929da9-18d2-5c95-bdec-e0ef0eec1e44',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EX13 UKP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EX13%20UKP&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 120840,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 206311,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782558/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197324,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199683,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 194544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 167097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782596/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2d929da9-18d2-5c95-bdec-e0ef0eec1e44/2d929da9-18d2-5c95-bdec-e0ef0eec1e44_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EX13UKP/698782613/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 TITANIUM X',
'vin': 'WF0CXXGAKCDM67692',
'year': 2013}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX13%2520UKP%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [bca.uk] INFO: Saving data for EX13%20UKP: {'created_time': 1774695898.041165, 'last_price_update_time': 1774695898.04118, 'auction_closing_time': 1774951200.0}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EX13%2520UKP') HTTP/1.1" 204 0
2026-03-28 11:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD56WYJ/42808082?sv=2020-08-04&st=2026-03-28T11%3A03%3A04Z&se=2026-03-28T11%3A28%3A04Z&sr=b&sp=r&sig=QwfENHEsfVtSe7uKxZStEM4prmDuwUsN3QtOskNq9IE%3D)
2026-03-28 11:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RY55%20ZKD-GB>
2026-03-28 11:04:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775537/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT12OGV/42807605?sv=2020-08-04&st=2026-03-28T11%3A03%3A02Z&se=2026-03-28T11%3A28%3A02Z&sr=b&sp=r&sig=cye%2F55EqABHigIBU9Kj8lsgibZSqvKwY%2F7sTcNulhH8%3D)
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8dab90>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698801919%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801919/600 saved to cache
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f6910>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775553%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775553/600 saved to cache
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d6610>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796517%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796517/600 saved to cache
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39a450>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLX64OPJ%252F698796533%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796533/600 saved to cache
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item af8b5473-208a-5762-a7c8-46860203893d
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: af8b5473-208a-5762-a7c8-46860203893d, skipping ID generation
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item af8b5473-208a-5762-a7c8-46860203893d sending to next pipeline
2026-03-28 11:04:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af8b5473-208a-5762-a7c8-46860203893d, identifier: LX64%20OPJ
2026-03-28 11:04:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:04:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:04:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb6710>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698802041%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802041/600 saved to cache
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff689d0>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_expert_report_file_07ccfb22-72ac-4cbf-979c-dd0ce60c28a6.pdf HTTP/1.1" 201 0
2026-03-28 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1ca16b7-d422-595f-b73a-e56ec1893e19, skipping ID generation
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSM13DLO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SM13DLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af8b5473-208a-5762-a7c8-46860203893d with identifier: LX64%20OPJ
2026-03-28 11:04:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af8b5473-208a-5762-a7c8-46860203893d with identifier: LX64%20OPJ
2026-03-28 11:04:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af8b5473-208a-5762-a7c8-46860203893d with identifier: LX64%20OPJ to the API
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796533/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_expert_report_file_7d6f78aa-8fde-49b8-aaeb-c60f2e25a9ba.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LX64%20OPJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af8b5473-208a-5762-a7c8-46860203893d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LX64 OPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LX64%20OPJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 45190,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44714,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42902,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 108759,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796593/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_af8b5473-208a-5762-a7c8-46860203893d/af8b5473-208a-5762-a7c8-46860203893d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LX64OPJ/698796603/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 DIG-S TEKNA Hatchback',
'transmission': 'automatic',
'trim': 'DIG-S TEKNA',
'vin': 'SJNTBAE12U1103414',
'year': 2015}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX64%2520OPJ%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [bca.uk] INFO: Saving data for LX64%20OPJ: {'created_time': 1774695898.818994, 'last_price_update_time': 1774695898.819006, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LX64%2520OPJ') HTTP/1.1" 204 0
2026-03-28 11:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818522>
2026-03-28 11:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931560>
2026-03-28 11:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG12%20VBZ-GB>
2026-03-28 11:04:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK08%20XKO-GB>
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294062%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294062 not downloaded yet
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4e9250>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_expert_report_file_bc9c863d-cea2-4e9c-96fc-d1db9d3f556d.pdf HTTP/1.1" 201 0
2026-03-28 11:04:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53, skipping ID generation
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEY66UZM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EY66UZM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff68cd0>
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR10UYM%252F698796512%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796512/600 saved to cache
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c
2026-03-28 11:04:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c, skipping ID generation
2026-03-28 11:04:58 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c sending to next pipeline
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c, identifier: LR10%20UYM
2026-03-28 11:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811926>
2026-03-28 11:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811971>
2026-03-28 11:04:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c with identifier: LR10%20UYM
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c with identifier: LR10%20UYM
2026-03-28 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c with identifier: LR10%20UYM to the API
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:04:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796512/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_expert_report_file_01ee8c97-c390-419b-ae1d-8efc7d8045f5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR10%20UYM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR10 UYM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR10%20UYM&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FIAT',
'model': 'GRANDE PUNTO',
'odometer': 38319,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42665,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40670,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77627,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c/ec1d2cb6-2d3d-5871-8e7b-ca4d54f1be3c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 102164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR10UYM/698796927/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FIAT GRANDE PUNTO 1.4 SOUND Hatchback',
'transmission': 'manual',
'trim': 'SOUND',
'vin': 'ZFA19900001640551',
'year': 2010}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR10%2520UYM%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [bca.uk] INFO: Saving data for LR10%20UYM: {'created_time': 1774695899.535911, 'last_price_update_time': 1774695899.535922, 'auction_closing_time': 1774778400.0}
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR10%2520UYM') HTTP/1.1" 204 0
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294064%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294064 not downloaded yet
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827650%27 HTTP/1.1" 200 None
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827650 not downloaded yet
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ab890>
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD56WYJ%252F698801911%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801911/600 saved to cache
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb
2026-03-28 11:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb, skipping ID generation
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb sending to next pipeline
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb, identifier: LD56%20WYJ
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad18e550>
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:04:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT12OGV%252F698775537%252F600') HTTP/1.1" 204 0
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775537/600 saved to cache
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1827e19-d691-5b45-bd7b-2374a12925ba
2026-03-28 11:04:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1827e19-d691-5b45-bd7b-2374a12925ba, skipping ID generation
2026-03-28 11:04:59 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1827e19-d691-5b45-bd7b-2374a12925ba sending to next pipeline
2026-03-28 11:04:59 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1827e19-d691-5b45-bd7b-2374a12925ba, identifier: LT12%20OGV
2026-03-28 11:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811902>
2026-03-28 11:04:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799337>
2026-03-28 11:04:59 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb with identifier: LD56%20WYJ
2026-03-28 11:04:59 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb with identifier: LD56%20WYJ
2026-03-28 11:04:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb with identifier: LD56%20WYJ to the API
2026-03-28 11:04:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801911/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_expert_report_file_96b2cabd-47e9-48f1-bc1a-4e4e1caf29ff.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD56%20WYJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD56 WYJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD56%20WYJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 92724,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43562,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801919/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801939/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801957/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698801975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98870,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802044/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93979,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb/8d04a0fb-34c3-59f6-938c-bb47bd2bbfeb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65664,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD56WYJ/698802097/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 S 80 Hatchback',
'transmission': 'manual',
'trim': 'S 80',
'vin': 'WVWZZZ9NZ7Y049683',
'year': 2006}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD56%2520WYJ%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [bca.uk] INFO: Saving data for LD56%20WYJ: {'created_time': 1774695900.316911, 'last_price_update_time': 1774695900.316925, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD56%2520WYJ') HTTP/1.1" 204 0
2026-03-28 11:05:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1827e19-d691-5b45-bd7b-2374a12925ba with identifier: LT12%20OGV
2026-03-28 11:05:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1827e19-d691-5b45-bd7b-2374a12925ba with identifier: LT12%20OGV
2026-03-28 11:05:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1827e19-d691-5b45-bd7b-2374a12925ba with identifier: LT12%20OGV to the API
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775537/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_expert_report_file_5fc7791c-1df9-4f9b-9bcb-e2d134ba6ff6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT12%20OGV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e1827e19-d691-5b45-bd7b-2374a12925ba',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT12 OGV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT12%20OGV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 53976,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44453,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775441/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775462/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43923,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775518/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775537/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42413,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775553/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80697,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1827e19-d691-5b45-bd7b-2374a12925ba/e1827e19-d691-5b45-bd7b-2374a12925ba_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT12OGV/698775668/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 ACENTA Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA',
'vin': 'MDHFBUK13U0084209',
'year': 2012}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT12%2520OGV%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [bca.uk] INFO: Saving data for LT12%20OGV: {'created_time': 1774695900.717023, 'last_price_update_time': 1774695900.717038, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT12%2520OGV') HTTP/1.1" 204 0
2026-03-28 11:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA58FEF/42808204?sv=2020-08-04&st=2026-03-28T11%3A02%3A58Z&se=2026-03-28T11%3A27%3A58Z&sr=b&sp=r&sig=J%2FeQRpcPtmyteKQXRm2uO9SdoEGpg6NVUfQOTjNO48Y%3D)
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294067%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294067 not downloaded yet
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827669%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827669 not downloaded yet
2026-03-28 11:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740383>
2026-03-28 11:05:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811968>
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb05a10>
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801877%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801877/600 saved to cache
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f73d0>
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801966%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801966/600 saved to cache
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294070%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294070 not downloaded yet
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827685%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827685 not downloaded yet
2026-03-28 11:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294073%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294073 not downloaded yet
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827703%27 HTTP/1.1" 200 None
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827703 not downloaded yet
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e541790>
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA58FEF%252F698801934%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801934/600 saved to cache
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d639b99c-69a4-57a3-aa72-b8c531763c23
2026-03-28 11:05:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d639b99c-69a4-57a3-aa72-b8c531763c23, skipping ID generation
2026-03-28 11:05:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d639b99c-69a4-57a3-aa72-b8c531763c23 sending to next pipeline
2026-03-28 11:05:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d639b99c-69a4-57a3-aa72-b8c531763c23, identifier: EA58%20FEF
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d639b99c-69a4-57a3-aa72-b8c531763c23 with identifier: EA58%20FEF
2026-03-28 11:05:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d639b99c-69a4-57a3-aa72-b8c531763c23 with identifier: EA58%20FEF
2026-03-28 11:05:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d639b99c-69a4-57a3-aa72-b8c531763c23 with identifier: EA58%20FEF to the API
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801934/600>
{'auction_title': '',
'c_o_2_emission_value': 180,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_expert_report_file_e8faa6cf-91e6-4140-85ab-3d5c04204c6f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA58%20FEF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd639b99c-69a4-57a3-aa72-b8c531763c23',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA58 FEF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA58%20FEF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'VECTRA',
'odometer': 70546,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47042,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45733,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801886/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41883,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801913/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83406,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698801966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d639b99c-69a4-57a3-aa72-b8c531763c23/d639b99c-69a4-57a3-aa72-b8c531763c23_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA58FEF/698802041/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL VECTRA 1.8 VVT SRI Estate',
'transmission': 'manual',
'trim': 'VVT SRI',
'vin': 'W0L0ZCF3581131311',
'year': 2009}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA58%2520FEF%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [bca.uk] INFO: Saving data for EA58%20FEF: {'created_time': 1774695901.53582, 'last_price_update_time': 1774695901.535833, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA58%2520FEF') HTTP/1.1" 204 0
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FG60TLX/42808448?sv=2020-08-04&st=2026-03-28T11%3A02%3A48Z&se=2026-03-28T11%3A27%3A48Z&sr=b&sp=r&sig=Pyw6W0B76KCem7hVGBrq7KPE9MFgv5%2Flt9taI1IywQM%3D)
2026-03-28 11:05:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827637/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EY66UZM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294076%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294076 not downloaded yet
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827711%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827711 not downloaded yet
2026-03-28 11:05:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294062>
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294081%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294081 not downloaded yet
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827724%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827724 not downloaded yet
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c4990>
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_expert_report_file_26cc0a2b-6f09-4e1a-b9ea-41f81c9d8d8e.pdf HTTP/1.1" 201 0
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b, skipping ID generation
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DAK08XKO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK08XKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fefd050>
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_expert_report_file_65fe57a9-37ce-4d19-a254-d06b762e2fb7.pdf HTTP/1.1" 201 0
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f, skipping ID generation
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKP15OKE-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP15OKE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb6a90>
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931560%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931560/600 saved to cache
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09da50>
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_expert_report_file_f4648263-e08b-4276-bd2d-10ca1434283e.pdf HTTP/1.1" 201 0
2026-03-28 11:05:01 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:01 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d413d90-c345-553a-b38f-78ab8e1be9c8, skipping ID generation
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DRY55ZKD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RY55ZKD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827650/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827650>
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294085%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294085 not downloaded yet
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827739%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827739 not downloaded yet
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827663%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827663 not downloaded yet
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822373%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822373 not downloaded yet
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817946%27 HTTP/1.1" 200 None
2026-03-28 11:05:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817946 not downloaded yet
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:05:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd11750>
2026-03-28 11:05:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_expert_report_file_b0a6d2b1-e633-4975-b9f3-b6c87337c132.pdf HTTP/1.1" 201 0
2026-03-28 11:05:02 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b7b4b43-f12a-505e-9392-e6bcd682c164, skipping ID generation
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYG12VBZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG12VBZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1a210>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFG60TLX%252F698818522%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818522/600 saved to cache
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c
2026-03-28 11:05:02 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c, skipping ID generation
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c sending to next pipeline
2026-03-28 11:05:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c, identifier: FG60%20TLX
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6bf50>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811971%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811971/600 saved to cache
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feffbd0>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811926%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811926/600 saved to cache
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827637/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294070>
2026-03-28 11:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827685>
2026-03-28 11:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827669>
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698294090%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294090 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827752%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827752 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827674%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827674 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822399%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822399 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817966%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817966 not downloaded yet
2026-03-28 11:05:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c with identifier: FG60%20TLX
2026-03-28 11:05:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c with identifier: FG60%20TLX
2026-03-28 11:05:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c with identifier: FG60%20TLX to the API
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818522/600>
{'auction_title': '',
'c_o_2_emission_value': 198,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_expert_report_file_4688a291-4904-4707-be91-aeb6d2d589d4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FG60%20TLX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FG60 TLX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FG60%20TLX&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'CHEVROLET',
'model': 'CAPTIVA',
'odometer': 139343,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818517/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47626,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818536/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45554,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818555/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 111682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818574/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91230,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818583/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c/9a0e5b2d-5cbd-5bc0-9c19-63ca38e9f84c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FG60TLX/698818591/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'CHEVROLET CAPTIVA 2.0 VCDI LT (7ST) StationWagon',
'transmission': 'manual',
'trim': 'VCDI LT (7ST)',
'vin': 'KL1CG26RJ7B094769',
'year': 2010}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG60%2520TLX%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [bca.uk] INFO: Saving data for FG60%20TLX: {'created_time': 1774695902.745427, 'last_price_update_time': 1774695902.745439, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FG60%2520TLX') HTTP/1.1" 204 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814303%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814303 not downloaded yet
2026-03-28 11:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294067>
2026-03-28 11:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827703/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827703>
2026-03-28 11:05:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294073>
2026-03-28 11:05:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827764%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827764 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827686%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827686 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822420%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822420 not downloaded yet
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817991%27 HTTP/1.1" 200 None
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817991 not downloaded yet
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffaa190>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799337%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799337/600 saved to cache
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb5ed0>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811902%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811902/600 saved to cache
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e876750>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811968%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811968/600 saved to cache
2026-03-28 11:05:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e383ad0>
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740383%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740383/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814322%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814322 not downloaded yet
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294064/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294064>
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294076>
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827711>
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827650/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827701%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827701 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822445%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822445 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818011%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818011 not downloaded yet
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e554dd0>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827637%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827637/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814337%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814337 not downloaded yet
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac249bd0>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294062%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294062/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827643/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=AK08XKO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=RY55ZKD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP15OKE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827713%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827713 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822468%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822468 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818044%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818044 not downloaded yet
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817946>
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814353%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814353 not downloaded yet
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827729%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827729 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822500%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822500 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818078%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818078 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814370%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814370 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827741%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827741 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822533%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822533 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818101%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818101 not downloaded yet
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e413690>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827650%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827650/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827703/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817966/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817966>
2026-03-28 11:05:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817991/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817991>
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814401%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814401 not downloaded yet
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294064/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827754%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827754 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822559%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822559 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818126%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818126 not downloaded yet
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcd7a50>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827669%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827669/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814428%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814428 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827769%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827769 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822582%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822582 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818152%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818152 not downloaded yet
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814454%27 HTTP/1.1" 200 None
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814454 not downloaded yet
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea8a8d0>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294073%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294073/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebcc350>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827685%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827685/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e620090>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294070%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294070/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea8a690>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827703%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827703/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcdb690>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827711%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827711/600 saved to cache
2026-03-28 11:05:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebcfe50>
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294067%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294067/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3e2d0>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294064%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294064/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e621dd0>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698817946%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817946/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5dac50>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294076%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294076/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818011/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818011>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818044/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818044>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822445/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822445>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814337>
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827643/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817991/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814484%27 HTTP/1.1" 200 None
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814484 not downloaded yet
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827741/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827741>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818078/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818078>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818101>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814370>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822533>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822500>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea64d0>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822361%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822361/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea4990>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698817926%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817926/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817966/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827769>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822582>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818152/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818152>
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818011/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822445/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818044/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fc990>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827643%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827643/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24f890>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698817991%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817991/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814454/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814454>
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94af49a450>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814337%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814337/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff4cf10>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698817966%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817966/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814484>
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814428>
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827741/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818078/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818152/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9816d0>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698818011%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818011/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d3350>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822445%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822445/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e505050>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698818044%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818044/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcddb90>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822533%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822533/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818126>
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827769/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e505f90>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814370%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814370/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d5710>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827741%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827741/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97cc50>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698818078%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818078/600 saved to cache
2026-03-28 11:05:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac48d890>
2026-03-28 11:05:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698818152%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818152/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb99010>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698818101%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818101/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e578390>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822500%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822500/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827754>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822559/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822559>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814401>
2026-03-28 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814454/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff694d0>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827769%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827769/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea78a50>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822582%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822582/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814353>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827729>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814322>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827701/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827701>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822468>
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827713/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827713>
2026-03-28 11:05:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/RY55ZKD/42808424?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=8GiFGbT4YIuxWSaz89Q6SfRehvTItSrQyOjTYUMbGBM%3D)
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea14990>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814428%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814428/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2c590>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814454%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814454/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac103d10>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814484%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814484/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822420>
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac103450>
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FRY55ZKD%252F698818126%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818126/600 saved to cache
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9d413d90-c345-553a-b38f-78ab8e1be9c8
2026-03-28 11:05:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9d413d90-c345-553a-b38f-78ab8e1be9c8, skipping ID generation
2026-03-28 11:05:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9d413d90-c345-553a-b38f-78ab8e1be9c8 sending to next pipeline
2026-03-28 11:05:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9d413d90-c345-553a-b38f-78ab8e1be9c8, identifier: RY55%20ZKD
2026-03-28 11:05:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9d413d90-c345-553a-b38f-78ab8e1be9c8 with identifier: RY55%20ZKD
2026-03-28 11:05:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9d413d90-c345-553a-b38f-78ab8e1be9c8 with identifier: RY55%20ZKD
2026-03-28 11:05:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9d413d90-c345-553a-b38f-78ab8e1be9c8 with identifier: RY55%20ZKD to the API
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818126/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_expert_report_file_f4648263-e08b-4276-bd2d-10ca1434283e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RY55%20ZKD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9d413d90-c345-553a-b38f-78ab8e1be9c8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RY55 ZKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RY55%20ZKD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 61824,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45283,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42598,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817966/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43001,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698817991/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42745,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818011/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818044/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818078/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9d413d90-c345-553a-b38f-78ab8e1be9c8/9d413d90-c345-553a-b38f-78ab8e1be9c8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/RY55ZKD/698818152/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 CLUB Hatchback',
'transmission': 'manual',
'trim': 'CLUB',
'vin': 'W0L0AHL4868062860',
'year': 2006}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY55%2520ZKD%27 HTTP/1.1" 200 None
2026-03-28 11:05:06 [bca.uk] INFO: Saving data for RY55%20ZKD: {'created_time': 1774695906.552046, 'last_price_update_time': 1774695906.552077, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RY55%2520ZKD') HTTP/1.1" 204 0
2026-03-28 11:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822399>
2026-03-28 11:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827686>
2026-03-28 11:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814303>
2026-03-28 11:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827764>
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827713/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822559/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827674/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827674>
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea4990>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827713%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827713/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827701/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec3810>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827754%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827754/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a96d0>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822559%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822559/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5122d0>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814401%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814401/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7bc50>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827729%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827729/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bdc50>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822468%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822468/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e3650>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827701%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827701/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e249cd0>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822420%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822420/600 saved to cache
2026-03-28 11:05:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff68a10>
2026-03-28 11:05:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814322%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814322/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3be710>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814353%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814353/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e382d90>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814303%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814303/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e24b510>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827686%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827686/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe5c0d0>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827764%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827764/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827674/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822373>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827663/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827663>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827739>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827752>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294090>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG12VBZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811875>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294081/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294081>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294085/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698294085>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931531/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931531>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SM13DLO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827724/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827724>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799334>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e412ed0>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822399%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822399/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf4e50>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827674%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827674/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG12VBZ/42808313?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=07uF1K47RHDe%2FVFKitc9c35JfNvjtfMbrWzB9D%2B1Dag%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP15OKE/42808529?sv=2020-08-04&st=2026-03-28T11%3A04%3A57Z&se=2026-03-28T11%3A29%3A57Z&sr=b&sp=r&sig=nWpiObEHcK%2B3X8RMtZcG58JrEk7nMfe8LMOGlniZXMY%3D)
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811844>
2026-03-28 11:05:07 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811897/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811897>
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827663/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AK08XKO/42808564?sv=2020-08-04&st=2026-03-28T11%3A04%3A58Z&se=2026-03-28T11%3A29%3A58Z&sr=b&sp=r&sig=MIl%2BYCT%2FeI%2FI24hrmyRRXdJsOl8X%2FsEmwsNntaq6%2BH8%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294081/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827724/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY66UZM/42808559?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=R9PCQdHCXy%2BbMh%2FZRz4xFYZXV%2FFfEjqJrPx2b4UIAYo%3D)
2026-03-28 11:05:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294085/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SM13DLO/42797503?sv=2020-08-04&st=2026-03-28T11%3A04%3A55Z&se=2026-03-28T11%3A29%3A55Z&sr=b&sp=r&sig=8WGyTwS3EWQXUsJ1CiTxgNk9BISzIcViWBTW95waxVg%3D)
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e411210>
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG12VBZ%252F698814290%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814290/600 saved to cache
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6b7b4b43-f12a-505e-9392-e6bcd682c164
2026-03-28 11:05:07 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6b7b4b43-f12a-505e-9392-e6bcd682c164, skipping ID generation
2026-03-28 11:05:07 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6b7b4b43-f12a-505e-9392-e6bcd682c164 sending to next pipeline
2026-03-28 11:05:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6b7b4b43-f12a-505e-9392-e6bcd682c164, identifier: YG12%20VBZ
2026-03-28 11:05:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6b7b4b43-f12a-505e-9392-e6bcd682c164 with identifier: YG12%20VBZ
2026-03-28 11:05:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6b7b4b43-f12a-505e-9392-e6bcd682c164 with identifier: YG12%20VBZ
2026-03-28 11:05:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6b7b4b43-f12a-505e-9392-e6bcd682c164 with identifier: YG12%20VBZ to the API
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814290/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_expert_report_file_b0a6d2b1-e633-4975-b9f3-b6c87337c132.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG12%20VBZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6b7b4b43-f12a-505e-9392-e6bcd682c164',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG12 VBZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG12%20VBZ&vehicleType=*',
'listing': 'auction',
'location': 'Leeds',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 108295,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40127,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38780,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814337/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 36446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64711,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814454/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6b7b4b43-f12a-505e-9392-e6bcd682c164/6b7b4b43-f12a-505e-9392-e6bcd682c164_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG12VBZ/698814484/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 VISIA Hatchback',
'transmission': 'manual',
'trim': 'VISIA',
'vin': 'SJNFBAF15U6210163',
'year': 2012}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG12%2520VBZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [bca.uk] INFO: Saving data for YG12%20VBZ: {'created_time': 1774695908.011538, 'last_price_update_time': 1774695908.011553, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG12%2520VBZ') HTTP/1.1" 204 0
2026-03-28 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931531/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799331/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799331>
2026-03-28 11:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740315>
2026-03-28 11:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO72%20HNA-GB>
2026-03-28 11:05:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799328>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebaf0d0>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP15OKE%252F698822373%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822373/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f
2026-03-28 11:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f, skipping ID generation
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f sending to next pipeline
2026-03-28 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f, identifier: KP15%20OKE
2026-03-28 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811897/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:05:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f with identifier: KP15%20OKE
2026-03-28 11:05:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f with identifier: KP15%20OKE
2026-03-28 11:05:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6a3c18aa-6942-5a10-8d8b-77d10ca1d47f with identifier: KP15%20OKE to the API
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822373/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_expert_report_file_65fe57a9-37ce-4d19-a254-d06b762e2fb7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP15%20OKE-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6a3c18aa-6942-5a10-8d8b-77d10ca1d47f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP15 OKE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP15%20OKE&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'MOKKA',
'odometer': 63181,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45036,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822420/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822445/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41041,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 112133,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100466,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822559/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6a3c18aa-6942-5a10-8d8b-77d10ca1d47f/6a3c18aa-6942-5a10-8d8b-77d10ca1d47f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98353,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP15OKE/698822582/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL MOKKA 1.4 T 140 SE 2WD StationWagon',
'transmission': 'manual',
'trim': 'T 140 SE 2WD',
'vin': 'W0LJD7E84FB118032',
'year': 2015}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP15%2520OKE%27 HTTP/1.1" 200 None
2026-03-28 11:05:08 [bca.uk] INFO: Saving data for KP15%20OKE: {'created_time': 1774695908.56828, 'last_price_update_time': 1774695908.568292, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP15%2520OKE') HTTP/1.1" 204 0
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e7390>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827739%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827739/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e249650>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294090%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294090/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8f7bd0>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAK08XKO%252F698827663%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827663/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b
2026-03-28 11:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b, skipping ID generation
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b sending to next pipeline
2026-03-28 11:05:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b, identifier: AK08%20XKO
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec1bd0>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827752%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827752/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb3cd0>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294059%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294059/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac398f90>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294081%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294081/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a8610>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811875%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811875/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e6250d0>
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY66UZM%252F698827724%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827724/600 saved to cache
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53
2026-03-28 11:05:08 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53, skipping ID generation
2026-03-28 11:05:08 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1cbab8dd-a028-53b2-85ad-4fd8767c3f53 sending to next pipeline
2026-03-28 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53, identifier: EY66%20UZM
2026-03-28 11:05:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb777d0>
2026-03-28 11:05:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSM13DLO%252F698294085%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294085/600 saved to cache
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1ca16b7-d422-595f-b73a-e56ec1893e19
2026-03-28 11:05:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1ca16b7-d422-595f-b73a-e56ec1893e19, skipping ID generation
2026-03-28 11:05:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1ca16b7-d422-595f-b73a-e56ec1893e19 sending to next pipeline
2026-03-28 11:05:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1ca16b7-d422-595f-b73a-e56ec1893e19, identifier: SM13%20DLO
2026-03-28 11:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782223/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782223>
2026-03-28 11:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811855/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811855>
2026-03-28 11:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811888>
2026-03-28 11:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740288>
2026-03-28 11:05:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA64%20XMM-GB>
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b with identifier: AK08%20XKO
2026-03-28 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b with identifier: AK08%20XKO
2026-03-28 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b with identifier: AK08%20XKO to the API
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827663/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_expert_report_file_26cc0a2b-6f09-4e1a-b9ea-41f81c9d8d8e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AK08%20XKO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AK08 XKO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AK08%20XKO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 39181,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827643/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827663/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44692,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827674/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827701/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44370,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827713/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b/11b7c2f9-a1d3-5cc0-ad78-c418b9cbb15b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90310,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AK08XKO/698827769/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 DESIGN 16V Hatchback',
'transmission': 'manual',
'trim': 'DESIGN 16V',
'vin': 'W0L0SDL6884290041',
'year': 2008}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK08%2520XKO%27 HTTP/1.1" 200 None
2026-03-28 11:05:09 [bca.uk] INFO: Saving data for AK08%20XKO: {'created_time': 1774695909.631378, 'last_price_update_time': 1774695909.631389, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AK08%2520XKO') HTTP/1.1" 204 0
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53 with identifier: EY66%20UZM
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=bronze HTTP/1.1" 200 None
2026-03-28 11:05:09 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53 with identifier: EY66%20UZM
2026-03-28 11:05:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1cbab8dd-a028-53b2-85ad-4fd8767c3f53 with identifier: EY66%20UZM to the API
2026-03-28 11:05:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827724/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_expert_report_file_bc9c863d-cea2-4e9c-96fc-d1db9d3f556d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY66%20UZM-GB',
'category': 'Car',
'color': 'bronze',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1cbab8dd-a028-53b2-85ad-4fd8767c3f53',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY66 UZM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY66%20UZM&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 46531,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827637/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827650/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40791,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41496,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43956,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827703/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827724/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1cbab8dd-a028-53b2-85ad-4fd8767c3f53/1cbab8dd-a028-53b2-85ad-4fd8767c3f53_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY66UZM/698827764/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.2 DIG-T N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T N-CONNECTA',
'vin': 'SJNFEAJ11U1819184',
'year': 2016}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520UZM%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [bca.uk] INFO: Saving data for EY66%20UZM: {'created_time': 1774695910.208109, 'last_price_update_time': 1774695910.208123, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY66%2520UZM') HTTP/1.1" 204 0
2026-03-28 11:05:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1ca16b7-d422-595f-b73a-e56ec1893e19 with identifier: SM13%20DLO
2026-03-28 11:05:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1ca16b7-d422-595f-b73a-e56ec1893e19 with identifier: SM13%20DLO
2026-03-28 11:05:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1ca16b7-d422-595f-b73a-e56ec1893e19 with identifier: SM13%20DLO to the API
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294085/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_expert_report_file_07ccfb22-72ac-4cbf-979c-dd0ce60c28a6.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SM13%20DLO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e1ca16b7-d422-595f-b73a-e56ec1893e19',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SM13 DLO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SM13%20DLO&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'PEUGEOT',
'model': '208',
'odometer': 92800,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43819,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294064/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45206,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43026,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294081/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78427,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294085/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1ca16b7-d422-595f-b73a-e56ec1893e19/e1ca16b7-d422-595f-b73a-e56ec1893e19_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92800,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SM13DLO/698294090/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.4 VTI ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'VTI ACTIVE',
'vin': 'VF3CA8FP0CW111993',
'year': 2013}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM13%2520DLO%27 HTTP/1.1" 200 None
2026-03-28 11:05:10 [bca.uk] INFO: Saving data for SM13%20DLO: {'created_time': 1774695910.63283, 'last_price_update_time': 1774695910.632844, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SM13%2520DLO') HTTP/1.1" 204 0
2026-03-28 11:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799325>
2026-03-28 11:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811792/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811792>
2026-03-28 11:05:10 [scrapy.extensions.logstats] INFO: Crawled 123 pages (at 27 pages/min), scraped 269 items (at 54 items/min)
2026-03-28 11:05:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8a9810>
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931531%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931531/600 saved to cache
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4cf950>
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799334%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799334/600 saved to cache
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff4e710>
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811897%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811897/600 saved to cache
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9ef450>
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811844%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811844/600 saved to cache
2026-03-28 11:05:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697931527>
2026-03-28 11:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782190/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782190>
2026-03-28 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799331/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811754/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811754>
2026-03-28 11:05:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811832/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811832>
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811855/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811792/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c33d0>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799328%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799328/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782190/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782223/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd1950>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_expert_report_file_dfe4d519-884e-4553-a45f-06bdeb923a12.pdf HTTP/1.1" 201 0
2026-03-28 11:05:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8cde9ac-9d88-54f8-905e-7cf70598e233, skipping ID generation
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEO72HNA-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO72HNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 already downloaded
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516208%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516208 not downloaded yet
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39c790>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740315%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740315/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad320dd0>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799331%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799331/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KY59LSX/42790293?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=1b4zVXS0OpzlXHK%2FK6mcycI0ZcuniDSWwdNXA6X3UgA%3D)
2026-03-28 11:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799320>
2026-03-28 11:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782160/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782160>
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516222%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516222 not downloaded yet
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc58c10>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811888%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811888/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e510590>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811855%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811855/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24f2d0>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811792%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811792/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea9110>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782190%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782190/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d0a90>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782223%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782223/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24e3d0>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740288%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740288/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740238>
2026-03-28 11:05:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827938>
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516233%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516233 not downloaded yet
2026-03-28 11:05:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811832/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516245%27 HTTP/1.1" 200 None
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516245 not downloaded yet
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d8ad0>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799325%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799325/600 saved to cache
2026-03-28 11:05:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d8510>
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKY59LSX%252F697931527%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931527/600 saved to cache
2026-03-28 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01
2026-03-28 11:05:12 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ef4002b7-d31e-55a1-86f4-a46e5d38dc01, skipping ID generation
2026-03-28 11:05:12 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ef4002b7-d31e-55a1-86f4-a46e5d38dc01 sending to next pipeline
2026-03-28 11:05:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ef4002b7-d31e-55a1-86f4-a46e5d38dc01, identifier: KY59%20LSX
2026-03-28 11:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811822/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811822>
2026-03-28 11:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799315/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799315>
2026-03-28 11:05:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782131>
2026-03-28 11:05:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ef4002b7-d31e-55a1-86f4-a46e5d38dc01 with identifier: KY59%20LSX
2026-03-28 11:05:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ef4002b7-d31e-55a1-86f4-a46e5d38dc01 with identifier: KY59%20LSX
2026-03-28 11:05:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ef4002b7-d31e-55a1-86f4-a46e5d38dc01 with identifier: KY59%20LSX to the API
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931527/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_expert_report_file_72dfc3c4-532b-4cfb-b136-aff60c3b19ea.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KY59%20LSX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ef4002b7-d31e-55a1-86f4-a46e5d38dc01',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KY59 LSX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KY59%20LSX&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 111222,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44876,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931529/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931530/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43411,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931531/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931532/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73804,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931544/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ef4002b7-d31e-55a1-86f4-a46e5d38dc01/ef4002b7-d31e-55a1-86f4-a46e5d38dc01_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KY59LSX/697931567/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 CLASSIC Hatchback',
'transmission': 'manual',
'trim': 'CLASSIC',
'vin': 'MALBA31BLAM007621',
'year': 2009}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY59%2520LSX%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [bca.uk] INFO: Saving data for KY59%20LSX: {'created_time': 1774695913.085157, 'last_price_update_time': 1774695913.08517, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KY59%2520LSX') HTTP/1.1" 204 0
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811754/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740228>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827932>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811729/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811729>
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516258%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516258 not downloaded yet
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782160/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516271%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516271 not downloaded yet
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae459450>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_expert_report_file_1080fd37-c70e-4459-9f58-f3e3e1851e9f.pdf HTTP/1.1" 201 0
2026-03-28 11:05:13 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02262c2b-f1a0-5da9-a14b-188ea3983135, skipping ID generation
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEA64XMM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA64XMM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e81d510>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811832%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811832/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516281%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516281 not downloaded yet
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516208>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516222>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516233>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698799313>
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661549%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661549 not downloaded yet
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516292%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516292 not downloaded yet
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e9a90>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811754%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811754/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ef750>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782160%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782160/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811729/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661560%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661560 not downloaded yet
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516303%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516303 not downloaded yet
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661571%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661571 not downloaded yet
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7ff50>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740238%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740238/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4eec10>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827938%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827938/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516245>
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811822/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516258>
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661581%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661581 not downloaded yet
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4f8890>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799320%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799320/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5dad10>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811729%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811729/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799315/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661590%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661590 not downloaded yet
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661603%27 HTTP/1.1" 200 None
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661603 not downloaded yet
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb0e050>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811822%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811822/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eba9b90>
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740228%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740228/600 saved to cache
2026-03-28 11:05:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516281/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516281>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661549>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EA64XMM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516271/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516271>
2026-03-28 11:05:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661619%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661619 not downloaded yet
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d3110>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782131%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782131/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9a2d0>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827932%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827932/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661639%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661639 not downloaded yet
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e29ad50>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799315%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799315/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6e410>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799313%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799313/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661652%27 HTTP/1.1" 200 None
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661652 not downloaded yet
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661571>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516303>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661560>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516292>
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4c290>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516258%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516258/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e249490>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516222%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516222/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4eba50>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516208%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516208/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2f750>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516233%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516233/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782098>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661581>
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516271/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e298990>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516245%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516245/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661603/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661603>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661619/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661619>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661590/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661590>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827940>
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516281/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9e6990>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516271%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516271/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661652/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661652>
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661639/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661639>
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EO72HNA/42801694?sv=2020-08-04&st=2026-03-28T11%3A05%3A07Z&se=2026-03-28T11%3A30%3A07Z&sr=b&sp=r&sig=gLHilNvXeWcKO%2F4UYfZWgv3plobMM1EZbOa3nLcEoQM%3D)
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bcd90>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661543%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661543/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d0350>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516281%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516281/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827927>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811702/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD19ARF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SV70XPL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661590/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661639/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661619/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661603/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe5d510>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661549%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661549/600 saved to cache
2026-03-28 11:05:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e3e90>
2026-03-28 11:05:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661560%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661560/600 saved to cache
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f6150>
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782098%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782098/600 saved to cache
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f4a50>
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661571%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661571/600 saved to cache
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe71910>
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661581%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661581/600 saved to cache
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad18d8d0>
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516303%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516303/600 saved to cache
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e2150>
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEO72HNA%252F698516292%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516292/600 saved to cache
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c8cde9ac-9d88-54f8-905e-7cf70598e233
2026-03-28 11:05:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c8cde9ac-9d88-54f8-905e-7cf70598e233, skipping ID generation
2026-03-28 11:05:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c8cde9ac-9d88-54f8-905e-7cf70598e233 sending to next pipeline
2026-03-28 11:05:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c8cde9ac-9d88-54f8-905e-7cf70598e233, identifier: EO72%20HNA
2026-03-28 11:05:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c8cde9ac-9d88-54f8-905e-7cf70598e233 with identifier: EO72%20HNA
2026-03-28 11:05:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c8cde9ac-9d88-54f8-905e-7cf70598e233 with identifier: EO72%20HNA
2026-03-28 11:05:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c8cde9ac-9d88-54f8-905e-7cf70598e233 with identifier: EO72%20HNA to the API
2026-03-28 11:05:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516292/600>
{'auction_title': '',
'c_o_2_emission_value': 191,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_expert_report_file_dfe4d519-884e-4553-a45f-06bdeb923a12.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO72%20HNA-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c8cde9ac-9d88-54f8-905e-7cf70598e233',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EO72 HNA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO72%20HNA&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FORD',
'model': 'TRANSIT CUSTOM',
'odometer': 85927,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 21922,
'Height': 300,
'OriginUrl': 'https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EO72HNA-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5',
'Width': 400},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516222/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 147942,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164034,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 106903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 150871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516271/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 137624,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516281/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c8cde9ac-9d88-54f8-905e-7cf70598e233/c8cde9ac-9d88-54f8-905e-7cf70598e233_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 113440,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EO72HNA/698516303/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'FORD TRANSIT CUSTOM 2.0 EBL 130 300 SWB TREND L/R PanelVan',
'transmission': 'manual',
'trim': 'EBL 130 300 SWB TREND L/R',
'vin': 'WF0YXXTTGYNU35629',
'year': 2022}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO72%2520HNA%27 HTTP/1.1" 200 None
2026-03-28 11:05:16 [bca.uk] INFO: Saving data for EO72%20HNA: {'created_time': 1774695916.165609, 'last_price_update_time': 1774695916.165624, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO72%2520HNA') HTTP/1.1" 204 0
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782067/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782067>
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799309/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GU05ZMV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827934/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827934>
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SV70XPL/42808063?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=KKtOM5WNFHVFkRmmLvYg9rdyBHoZ8OT27F1y6vVYLq8%3D)
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827919/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827919>
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698740204>
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV14%20AZO-GB>
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661652/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA64XMM/42805542?sv=2020-08-04&st=2026-03-28T11%3A05%3A08Z&se=2026-03-28T11%3A30%3A08Z&sr=b&sp=r&sig=K%2BvddG9%2BUE6bTEEDdg1P0QCCGdSjqgNMnYe6pIzX9DE%3D)
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe99810>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661590%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661590/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39c950>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661639%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661639/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac381f50>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661619%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661619/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42d5d0>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661603%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661603/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec99d0>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827940%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827940/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811702/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD19ARF/42807926?sv=2020-08-04&st=2026-03-28T11%3A02%3A45Z&se=2026-03-28T11%3A27%3A45Z&sr=b&sp=r&sig=fEaE3yyWCLi0LXAVaVI5dY7HrZJr2NqQikC4OJGyOM4%3D)
2026-03-28 11:05:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811970>
2026-03-28 11:05:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39ff10>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSV70XPL%252F698811719%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811719/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f2e9e7ea-51b4-5374-8434-69f905958f69
2026-03-28 11:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f2e9e7ea-51b4-5374-8434-69f905958f69, skipping ID generation
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f2e9e7ea-51b4-5374-8434-69f905958f69 sending to next pipeline
2026-03-28 11:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f2e9e7ea-51b4-5374-8434-69f905958f69, identifier: SV70%20XPL
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:16 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9ad10>
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA64XMM%252F698661652%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661652/600 saved to cache
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 02262c2b-f1a0-5da9-a14b-188ea3983135
2026-03-28 11:05:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 02262c2b-f1a0-5da9-a14b-188ea3983135, skipping ID generation
2026-03-28 11:05:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 02262c2b-f1a0-5da9-a14b-188ea3983135 sending to next pipeline
2026-03-28 11:05:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 02262c2b-f1a0-5da9-a14b-188ea3983135, identifier: EA64%20XMM
2026-03-28 11:05:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f2e9e7ea-51b4-5374-8434-69f905958f69 with identifier: SV70%20XPL
2026-03-28 11:05:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f2e9e7ea-51b4-5374-8434-69f905958f69 with identifier: SV70%20XPL
2026-03-28 11:05:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f2e9e7ea-51b4-5374-8434-69f905958f69 with identifier: SV70%20XPL to the API
2026-03-28 11:05:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811719/600>
{'auction_title': '',
'c_o_2_emission_value': 193,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_expert_report_file_84463669-9e1f-4582-99f2-b0a1acbbee35.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SV70%20XPL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f2e9e7ea-51b4-5374-8434-69f905958f69',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SV70 XPL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SV70%20XPL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '840I GRAN COUPE',
'odometer': 41796,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41983,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811729/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45666,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811743/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43403,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811754/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811792/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41182,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f2e9e7ea-51b4-5374-8434-69f905958f69/f2e9e7ea-51b4-5374-8434-69f905958f69_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SV70XPL/698811926/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'BMW 840I GRAN COUPE 3.0 333 SDRIVE M SPORT Coupe',
'transmission': 'automatic',
'trim': '333 SDRIVE M SPORT',
'vin': 'WBAGV22070CF91984',
'year': 2020}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV70%2520XPL%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [bca.uk] INFO: Saving data for SV70%20XPL: {'created_time': 1774695917.286843, 'last_price_update_time': 1774695917.286855, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SV70%2520XPL') HTTP/1.1" 204 0
2026-03-28 11:05:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 02262c2b-f1a0-5da9-a14b-188ea3983135 with identifier: EA64%20XMM
2026-03-28 11:05:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 02262c2b-f1a0-5da9-a14b-188ea3983135 with identifier: EA64%20XMM
2026-03-28 11:05:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 02262c2b-f1a0-5da9-a14b-188ea3983135 with identifier: EA64%20XMM to the API
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661652/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_expert_report_file_1080fd37-c70e-4459-9f58-f3e3e1851e9f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA64%20XMM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '02262c2b-f1a0-5da9-a14b-188ea3983135',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA64 XMM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA64%20XMM&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 14589,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46802,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44250,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43827,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661571/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45192,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43574,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661590/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661603/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661619/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661639/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_02262c2b-f1a0-5da9-a14b-188ea3983135/02262c2b-f1a0-5da9-a14b-188ea3983135_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA64XMM/698661652/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'ACENTA',
'vin': 'MDHFBUK13U0787202',
'year': 2014}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA64%2520XMM%27 HTTP/1.1" 200 None
2026-03-28 11:05:17 [bca.uk] INFO: Saving data for EA64%20XMM: {'created_time': 1774695917.796539, 'last_price_update_time': 1774695917.796553, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA64%2520XMM') HTTP/1.1" 204 0
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782067/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811954>
2026-03-28 11:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BJ66YWK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HX68KXL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827911>
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827934/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799309/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU05ZMV/42808081?sv=2020-08-04&st=2026-03-28T11%3A02%3A44Z&se=2026-03-28T11%3A27%3A44Z&sr=b&sp=r&sig=c4ZMoLysDGt8CPmkKcPObA3mKUg4URVE0Sw2qlmZmeI%3D)
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7b890>
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD19ARF%252F698811702%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811702/600 saved to cache
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9627a815-843b-5104-8c72-e08099ef2ec0
2026-03-28 11:05:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9627a815-843b-5104-8c72-e08099ef2ec0, skipping ID generation
2026-03-28 11:05:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9627a815-843b-5104-8c72-e08099ef2ec0 sending to next pipeline
2026-03-28 11:05:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9627a815-843b-5104-8c72-e08099ef2ec0, identifier: FD19%20ARF
2026-03-28 11:05:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4da1d0>
2026-03-28 11:05:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827927%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827927/600 saved to cache
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9627a815-843b-5104-8c72-e08099ef2ec0 with identifier: FD19%20ARF
2026-03-28 11:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9627a815-843b-5104-8c72-e08099ef2ec0 with identifier: FD19%20ARF
2026-03-28 11:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9627a815-843b-5104-8c72-e08099ef2ec0 with identifier: FD19%20ARF to the API
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811702/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_expert_report_file_b2026b99-13f3-4ff4-8dfa-fcc412c96e13.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD19%20ARF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9627a815-843b-5104-8c72-e08099ef2ec0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD19 ARF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD19%20ARF&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 33495,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811702/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40826,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811741/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811783/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811832/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811855/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811897/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71224,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9627a815-843b-5104-8c72-e08099ef2ec0/9627a815-843b-5104-8c72-e08099ef2ec0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD19ARF/698811971/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 TITANIUM X P/S Hatchback',
'transmission': 'automatic',
'trim': 'E/B 100 TITANIUM X P/S',
'vin': 'WF0JXXGAHJKE49110',
'year': 2019}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD19%2520ARF%27 HTTP/1.1" 200 None
2026-03-28 11:05:18 [bca.uk] INFO: Saving data for FD19%20ARF: {'created_time': 1774695918.474133, 'last_price_update_time': 1774695918.474146, 'auction_closing_time': 1774864800.0}
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD19%2520ARF') HTTP/1.1" 204 0
2026-03-28 11:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827917/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827917>
2026-03-28 11:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782009/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782009>
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811895/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811895>
2026-03-28 11:05:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK58XAN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827919/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e57b310>
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782067%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782067/600 saved to cache
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e249950>
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827934%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827934/600 saved to cache
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4216d0>
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU05ZMV%252F698799309%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799309/600 saved to cache
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fb67be3a-90c8-5a60-a598-4f91805ebe76
2026-03-28 11:05:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fb67be3a-90c8-5a60-a598-4f91805ebe76, skipping ID generation
2026-03-28 11:05:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fb67be3a-90c8-5a60-a598-4f91805ebe76 sending to next pipeline
2026-03-28 11:05:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fb67be3a-90c8-5a60-a598-4f91805ebe76, identifier: GU05%20ZMV
2026-03-28 11:05:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fb67be3a-90c8-5a60-a598-4f91805ebe76 with identifier: GU05%20ZMV
2026-03-28 11:05:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fb67be3a-90c8-5a60-a598-4f91805ebe76 with identifier: GU05%20ZMV
2026-03-28 11:05:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fb67be3a-90c8-5a60-a598-4f91805ebe76 with identifier: GU05%20ZMV to the API
2026-03-28 11:05:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799309/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_expert_report_file_c54b27fb-3228-45f6-9d9d-2b443ab99b48.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU05%20ZMV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fb67be3a-90c8-5a60-a598-4f91805ebe76',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU05 ZMV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU05%20ZMV&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'HONDA',
'model': 'JAZZ',
'odometer': 151498,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175721,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799309/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 186270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174337,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 169563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 140789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 154338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799331/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 151530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799334/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fb67be3a-90c8-5a60-a598-4f91805ebe76/fb67be3a-90c8-5a60-a598-4f91805ebe76_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159311,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU05ZMV/698799337/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'HONDA JAZZ 1.4 I-DSI SE CVT-7 Hatchback',
'transmission': 'manual',
'trim': 'I-DSI SE CVT-7',
'vin': 'JHMGD18505S231283',
'year': 2005}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU05%2520ZMV%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [bca.uk] INFO: Saving data for GU05%20ZMV: {'created_time': 1774695919.181881, 'last_price_update_time': 1774695919.181892, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU05%2520ZMV') HTTP/1.1" 204 0
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HX68KXL/42806268?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=puJnxD3yai%2BJ6OwfRb23wiMXgXCtq5xPwT9gfDR2JX0%3D)
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BJ66YWK/42808367?sv=2020-08-04&st=2026-03-28T11%3A02%3A43Z&se=2026-03-28T11%3A27%3A43Z&sr=b&sp=r&sig=9n5FlqGQqX%2BvljnF%2BmOvxXPWfQUoDfg0AEeBRUJPNDY%3D)
2026-03-28 11:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811870/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811870>
2026-03-28 11:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG65%20ETD-GB>
2026-03-28 11:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827900/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827900>
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e850cd0>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740204%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740204/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e551e90>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811970%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811970/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a3690>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827919%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827919/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39c290>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_expert_report_file_166622ef-f02a-4b89-af07-b266ccc80be1.pdf HTTP/1.1" 201 0
2026-03-28 11:05:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a93f474b-9a84-5577-a127-e359e20b9ab5, skipping ID generation
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLV14AZO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV14AZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782009/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK58XAN/42807562?sv=2020-08-04&st=2026-03-28T11%3A02%3A40Z&se=2026-03-28T11%3A27%3A40Z&sr=b&sp=r&sig=oEceJZyN8IfjP4HiY7TDMoGUCic2%2Ff2yoFpAVcsD0XM%3D)
2026-03-28 11:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811830>
2026-03-28 11:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827884>
2026-03-28 11:05:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA66DBU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817964%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817964 not downloaded yet
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811895/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813391%27 HTTP/1.1" 200 None
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813391 not downloaded yet
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff68750>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHX68KXL%252F698740189%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740189/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item be8bbf41-9ce9-501b-87fe-5d2475363c5c
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: be8bbf41-9ce9-501b-87fe-5d2475363c5c, skipping ID generation
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item be8bbf41-9ce9-501b-87fe-5d2475363c5c sending to next pipeline
2026-03-28 11:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: be8bbf41-9ce9-501b-87fe-5d2475363c5c, identifier: HX68%20KXL
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff99510>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBJ66YWK%252F698811709%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811709/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6
2026-03-28 11:05:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6, skipping ID generation
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4d7fc53d-be7b-5dec-a85f-f55a8de317f6 sending to next pipeline
2026-03-28 11:05:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6, identifier: BJ66%20YWK
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9e4290>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827911%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827911/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:19 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feabf10>
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811954%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811954/600 saved to cache
2026-03-28 11:05:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:05:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827917/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: be8bbf41-9ce9-501b-87fe-5d2475363c5c with identifier: HX68%20KXL
2026-03-28 11:05:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: be8bbf41-9ce9-501b-87fe-5d2475363c5c with identifier: HX68%20KXL
2026-03-28 11:05:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: be8bbf41-9ce9-501b-87fe-5d2475363c5c with identifier: HX68%20KXL to the API
2026-03-28 11:05:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740189/600>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_expert_report_file_af4e631a-c1e9-4ea8-9771-d661a9efadd3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HX68%20KXL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'be8bbf41-9ce9-501b-87fe-5d2475363c5c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HX68 KXL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HX68%20KXL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'JEEP',
'model': 'COMPASS',
'odometer': 120228,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 12,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740217/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740253/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740288/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740356/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_be8bbf41-9ce9-501b-87fe-5d2475363c5c/be8bbf41-9ce9-501b-87fe-5d2475363c5c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HX68KXL/698740383/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'JEEP COMPASS 1.4 M/AIR 140 2WD LONGITUDE StationWagon',
'transmission': 'manual',
'trim': 'M/AIR 140 2WD LONGITUDE',
'vin': 'MCANJPBH9JFA35213',
'year': 2018}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX68%2520KXL%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [bca.uk] INFO: Saving data for HX68%20KXL: {'created_time': 1774695920.300111, 'last_price_update_time': 1774695920.300122, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HX68%2520KXL') HTTP/1.1" 204 0
2026-03-28 11:05:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6 with identifier: BJ66%20YWK
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=Diesel%2FElectric HTTP/1.1" 200 None
2026-03-28 11:05:20 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6 with identifier: BJ66%20YWK
2026-03-28 11:05:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4d7fc53d-be7b-5dec-a85f-f55a8de317f6 with identifier: BJ66%20YWK to the API
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811709/600>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_expert_report_file_9ef6435f-43b9-424d-b2d3-1742a16e8cba.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ66%20YWK-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel/Electric',
'id': '4d7fc53d-be7b-5dec-a85f-f55a8de317f6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ66 YWK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ66%20YWK&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'C300 H',
'odometer': 152283,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811709/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811755/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43538,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811799/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42115,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811822/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40655,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811863/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67614,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811948/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4d7fc53d-be7b-5dec-a85f-f55a8de317f6/4d7fc53d-be7b-5dec-a85f-f55a8de317f6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83044,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BJ66YWK/698811968/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C300 H 2.1 AMG LINE PREMIUM Saloon',
'transmission': 'manual',
'trim': 'AMG LINE PREMIUM',
'vin': 'WDD2050122F409279',
'year': 2016}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520YWK%27 HTTP/1.1" 200 None
2026-03-28 11:05:20 [bca.uk] INFO: Saving data for BJ66%20YWK: {'created_time': 1774695920.962308, 'last_price_update_time': 1774695920.962321, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ66%2520YWK') HTTP/1.1" 204 0
2026-03-28 11:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827881/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827881>
2026-03-28 11:05:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG64%20KJZ-GB>
2026-03-28 11:05:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811870/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827900/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT62%20XMJ-GB>
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817989%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817989 not downloaded yet
2026-03-28 11:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LP66TZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813417%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813417 not downloaded yet
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c4650>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698782009%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782009/600 saved to cache
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42d310>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK58XAN%252F698781965%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781965/600 saved to cache
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02
2026-03-28 11:05:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 86c3d5ed-6b33-5aac-81cc-1442ec105e02, skipping ID generation
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 86c3d5ed-6b33-5aac-81cc-1442ec105e02 sending to next pipeline
2026-03-28 11:05:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 86c3d5ed-6b33-5aac-81cc-1442ec105e02, identifier: EK58%20XAN
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4db050>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811895%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811895/600 saved to cache
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:21 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe99110>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827917%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827917/600 saved to cache
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818010%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818010 not downloaded yet
2026-03-28 11:05:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 86c3d5ed-6b33-5aac-81cc-1442ec105e02 with identifier: EK58%20XAN
2026-03-28 11:05:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 86c3d5ed-6b33-5aac-81cc-1442ec105e02 with identifier: EK58%20XAN
2026-03-28 11:05:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 86c3d5ed-6b33-5aac-81cc-1442ec105e02 with identifier: EK58%20XAN to the API
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781965/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_expert_report_file_68325829-7be7-4a62-9e9b-3c4c6e08b5df.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK58%20XAN-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '86c3d5ed-6b33-5aac-81cc-1442ec105e02',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK58 XAN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK58%20XAN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 89136,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42302,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39408,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698781982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43229,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782009/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41102,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782032/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41512,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782067/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81843,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782160/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93889,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782190/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_86c3d5ed-6b33-5aac-81cc-1442ec105e02/86c3d5ed-6b33-5aac-81cc-1442ec105e02_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK58XAN/698782223/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 BREEZE 16V Hatchback',
'transmission': 'manual',
'trim': 'BREEZE 16V',
'vin': 'W0L0SDL6884473377',
'year': 2008}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK58%2520XAN%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [bca.uk] INFO: Saving data for EK58%20XAN: {'created_time': 1774695921.886422, 'last_price_update_time': 1774695921.886433, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK58%2520XAN') HTTP/1.1" 204 0
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA66DBU/42808416?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=2bMxHiVhv5JTBGrCm8PYX%2F1W9yWgdelbzrn8A5d%2BK1c%3D)
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731515/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731515>
2026-03-28 11:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817932/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LV14AZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817964/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817964>
2026-03-28 11:05:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CK63ERY/42808357?sv=2020-08-04&st=2026-03-28T11%3A02%3A38Z&se=2026-03-28T11%3A27%3A38Z&sr=b&sp=r&sig=CfB7anud9vNuBq9xEcMiGMvTVAZeS3miMkpvupg3gpc%3D)
2026-03-28 11:05:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF18%20ZPB-GB>
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813453%27 HTTP/1.1" 200 None
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813453 not downloaded yet
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7f810>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811870%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811870/600 saved to cache
2026-03-28 11:05:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebcdc10>
2026-03-28 11:05:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827900%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827900/600 saved to cache
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e82d690>
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_expert_report_file_fb896a74-55e6-40ac-8030-abf273acc2ea.pdf HTTP/1.1" 201 0
2026-03-28 11:05:22 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b688c5d-461a-59e2-96c9-84371012ae94, skipping ID generation
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNG65ETD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NG65ETD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818045%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818045 not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776177%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776177 not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813480%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813480 not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776188%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776188 not downloaded yet
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7a3d0>
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA66DBU%252F698827885%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827885/600 saved to cache
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0fd76365-0d93-5f43-bb85-e0898d18c703
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0fd76365-0d93-5f43-bb85-e0898d18c703, skipping ID generation
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0fd76365-0d93-5f43-bb85-e0898d18c703 sending to next pipeline
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0fd76365-0d93-5f43-bb85-e0898d18c703, identifier: MA66%20DBU
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9abd0>
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827884%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827884/600 saved to cache
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc27690>
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCK63ERY%252F698811830%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811830/600 saved to cache
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b907f1ba-0626-5f40-a68a-546b49ab434a
2026-03-28 11:05:22 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b907f1ba-0626-5f40-a68a-546b49ab434a, skipping ID generation
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b907f1ba-0626-5f40-a68a-546b49ab434a sending to next pipeline
2026-03-28 11:05:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b907f1ba-0626-5f40-a68a-546b49ab434a, identifier: CK63%20ERY
2026-03-28 11:05:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813391>
2026-03-28 11:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817989>
2026-03-28 11:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787244>
2026-03-28 11:05:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794293>
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818060%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818060 not downloaded yet
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776208%27 HTTP/1.1" 200 None
2026-03-28 11:05:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776208 not downloaded yet
2026-03-28 11:05:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0fd76365-0d93-5f43-bb85-e0898d18c703 with identifier: MA66%20DBU
2026-03-28 11:05:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0fd76365-0d93-5f43-bb85-e0898d18c703 with identifier: MA66%20DBU
2026-03-28 11:05:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0fd76365-0d93-5f43-bb85-e0898d18c703 with identifier: MA66%20DBU to the API
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827885/600>
{'auction_title': '',
'c_o_2_emission_value': 128,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_expert_report_file_867d98ec-57dd-4bab-9d92-e6ff87b94c03.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA66%20DBU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0fd76365-0d93-5f43-bb85-e0898d18c703',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA66 DBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA66%20DBU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 59686,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41510,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44155,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42611,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827901/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827905/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89173,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827919/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72120,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827927/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88517,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827932/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0fd76365-0d93-5f43-bb85-e0898d18c703/0fd76365-0d93-5f43-bb85-e0898d18c703_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 99356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA66DBU/698827938/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.2 DIG-T 113 N-CONNECTA Hatchback',
'transmission': 'manual',
'trim': 'DIG-T 113 N-CONNECTA',
'vin': 'SJNFEAF15U7255826',
'year': 2016}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA66%2520DBU%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [bca.uk] INFO: Saving data for MA66%20DBU: {'created_time': 1774695923.018859, 'last_price_update_time': 1774695923.018871, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA66%2520DBU') HTTP/1.1" 204 0
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b907f1ba-0626-5f40-a68a-546b49ab434a with identifier: CK63%20ERY
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b907f1ba-0626-5f40-a68a-546b49ab434a with identifier: CK63%20ERY
2026-03-28 11:05:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b907f1ba-0626-5f40-a68a-546b49ab434a with identifier: CK63%20ERY to the API
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811830/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_expert_report_file_32f9e2e9-0942-4e4f-84c7-493ea5327005.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK63%20ERY-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b907f1ba-0626-5f40-a68a-546b49ab434a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK63 ERY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK63%20ERY&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 142949,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44390,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45429,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811804/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811846/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811870/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811895/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78608,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811954/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b907f1ba-0626-5f40-a68a-546b49ab434a/b907f1ba-0626-5f40-a68a-546b49ab434a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CK63ERY/698811970/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 163 4WD TITANIUM',
'vin': 'WF0AXXWPMADK66613',
'year': 2013}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK63%2520ERY%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [bca.uk] INFO: Saving data for CK63%20ERY: {'created_time': 1774695923.486889, 'last_price_update_time': 1774695923.486903, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK63%2520ERY') HTTP/1.1" 204 0
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827881/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LP66TZU/42808501?sv=2020-08-04&st=2026-03-28T11%3A02%3A39Z&se=2026-03-28T11%3A27%3A39Z&sr=b&sp=r&sig=pSgsW0dYnaVvnRS82wtcDJuh0sp0HuXHE5N8VIJIzYQ%3D)
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776226%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776226 not downloaded yet
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776244%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776244 not downloaded yet
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd36d0>
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_expert_report_file_182e47b2-c9f4-437d-aa85-44152f2ef299.pdf HTTP/1.1" 201 0
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5bb8527-4699-5922-9d9e-bf80d1714c97, skipping ID generation
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBT62XMJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT62XMJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e846750>
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827876%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827876/600 saved to cache
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817932/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662016/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662016>
2026-03-28 11:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818010>
2026-03-28 11:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813417>
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817964/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776150/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NG65ETD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776272%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776272 not downloaded yet
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811767%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811767 not downloaded yet
2026-03-28 11:05:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731515/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdbe3d0>
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLP66TZU%252F698827881%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827881/600 saved to cache
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2, skipping ID generation
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9abf9c5b-566d-50c3-95b1-ae8d85d04da2 sending to next pipeline
2026-03-28 11:05:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2, identifier: LP66%20TZU
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3ee10>
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_expert_report_file_9bdf4cf9-0bfc-4b7a-92f6-7e0ad72703b5.pdf HTTP/1.1" 201 0
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1dc24d5-e7ba-51c0-bd83-ba297100a29a, skipping ID generation
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSG64KJZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SG64KJZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ff150>
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_expert_report_file_0c72b400-375b-4829-bebb-f057d6df868c.pdf HTTP/1.1" 201 0
2026-03-28 11:05:23 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:23 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2d9cc75-bcde-5f91-a58f-521245e3769d, skipping ID generation
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBF18ZPB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BF18ZPB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776297%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776297 not downloaded yet
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811791%27 HTTP/1.1" 200 None
2026-03-28 11:05:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811791 not downloaded yet
2026-03-28 11:05:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2 with identifier: LP66%20TZU
2026-03-28 11:05:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2 with identifier: LP66%20TZU
2026-03-28 11:05:24 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9abf9c5b-566d-50c3-95b1-ae8d85d04da2 with identifier: LP66%20TZU to the API
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:24 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827881/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_expert_report_file_28a65092-d63e-4eef-991b-620a69a05764.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP66%20TZU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9abf9c5b-566d-50c3-95b1-ae8d85d04da2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LP66 TZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LP66%20TZU&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'AUDI',
'model': 'A1',
'odometer': 49764,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43781,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40976,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827881/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43387,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827891/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827900/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827917/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827934/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9abf9c5b-566d-50c3-95b1-ae8d85d04da2/9abf9c5b-566d-50c3-95b1-ae8d85d04da2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75345,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LP66TZU/698827940/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'AUDI A1 1.4 TFSI 150 S LINE Hatchback',
'transmission': 'manual',
'trim': 'TFSI 150 S LINE',
'vin': 'WAUZZZ8X1HB038322',
'year': 2017}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP66%2520TZU%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [bca.uk] INFO: Saving data for LP66%20TZU: {'created_time': 1774695924.47023, 'last_price_update_time': 1774695924.470244, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LP66%2520TZU') HTTP/1.1" 204 0
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794293/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787844%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787844 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781995%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781995 not downloaded yet
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776188/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776188>
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813480/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813480>
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776208>
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776226/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776226>
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776314%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776314 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811820%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811820 not downloaded yet
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff4f690>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698817932%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817932/600 saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e36d310>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698817964%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817964/600 saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e624cd0>
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731515%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731515/600 saved to cache
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787852%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787852 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782023%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782023 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698776328%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776328 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811843%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811843 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787858%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787858 not downloaded yet
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782059%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782059 not downloaded yet
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776150/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776244>
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811718/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BT62XMJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818060/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818060>
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811865%27 HTTP/1.1" 200 None
2026-03-28 11:05:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811865 not downloaded yet
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776226/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787862%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787862 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782082%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782082 not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae890910>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794293%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794293/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42c410>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698817989%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817989/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e876790>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698813391%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813391/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662016/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811887%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811887 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787866%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787866 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782103%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782103 not downloaded yet
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9811d0>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787244%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787244/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811912%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811912 not downloaded yet
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776297/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776297>
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BF18ZPB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811791/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811791>
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813480/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811820/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811820>
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776188/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787874%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787874 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782139%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782139 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811941%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811941 not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6ef90>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776150%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776150/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad323ad0>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698818010%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818010/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e534cd0>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698813417%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813417/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e421310>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776226%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776226/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e875b50>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662016%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662016/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787884%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787884 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782167%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782167 not downloaded yet
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818060/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811965%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811965 not downloaded yet
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811718/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787892%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787892 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782200%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782200 not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac423450>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776208%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776208/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe2af90>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698813480%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813480/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c1810>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776188%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776188/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782059>
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811843>
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782082/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782082>
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787858/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787858>
2026-03-28 11:05:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776328>
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811820/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787901%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787901 not downloaded yet
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782222%27 HTTP/1.1" 200 None
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782222 not downloaded yet
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff4c950>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698818060%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818060/600 saved to cache
2026-03-28 11:05:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3bd350>
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811718%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811718/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811791/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787866/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787866>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782103/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782103>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811912>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782167/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782167>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811941/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811941>
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776297/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e535d50>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776244%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776244/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5532d0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811820%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811820/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782200/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782200>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787892>
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811941/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787858/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea179d0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811791%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811791/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea7fa90>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698781975%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781975/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffaa0d0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776297%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776297/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811912/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8df9d0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776328%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776328/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb98650>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811941%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811941/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e39cbd0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787858%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787858/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782167/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782082/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782222>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811965>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787901/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787901>
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787866/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782103/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa9a90>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811843%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811843/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e535310>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811912%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811912/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787884>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811887>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782139/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782139>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787862>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787874/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787874>
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787901/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782200/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f7210>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782167%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782167/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fefda50>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782059%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782059/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e875e90>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782082%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782082/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9ed0d0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787866%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787866/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea279d0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782103%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782103/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782023/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782023>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781995/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781995>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811865/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811865>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776314>
2026-03-28 11:05:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787852>
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787874/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb81ed0>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787901%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787901/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e518410>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787892%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787892/600 saved to cache
2026-03-28 11:05:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb80350>
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782200%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782200/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787844/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787844>
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782139/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e51b710>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787874%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787874/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe70cd0>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811965%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811965/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8de390>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782222%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782222/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811767/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811767>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787837/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SG64KJZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811865/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9da690>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787862%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787862/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2cd90>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787884%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787884/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6f950>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782139%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782139/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f4fd0>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811887%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811887/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782023/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776272>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813453>
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787844/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818045/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818045>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698776177>
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781995/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF18ZPB/42807758?sv=2020-08-04&st=2026-03-28T11%3A05%3A21Z&se=2026-03-28T11%3A30%3A21Z&sr=b&sp=r&sig=%2F96NkTK0LS%2F%2FmBNYGurapSbbL2xGrA9wn7NxgYB3WI8%3D)
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6d290>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787852%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787852/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d0cd0>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811865%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811865/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e24b250>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776314%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776314/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719455>
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787837/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SG64KJZ/42807791?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=f%2B2HUE2whoqKsSM1nveQzApRpkyPGk%2BjJVZgwBtYBRc%3D)
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822534>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662010/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662010>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731502/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731502>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797555/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797555>
2026-03-28 11:05:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794304>
2026-03-28 11:05:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811767/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT62XMJ/42808176?sv=2020-08-04&st=2026-03-28T11%3A05%3A19Z&se=2026-03-28T11%3A30%3A19Z&sr=b&sp=r&sig=zKGtB5YGo10ofgmmppwQoQcB91PRMLjfUIeuQJmGzBQ%3D)
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e57b710>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698782023%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782023/600 saved to cache
2026-03-28 11:05:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2c7d0>
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787844%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787844/600 saved to cache
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d0c50>
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF18ZPB%252F698781995%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781995/600 saved to cache
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a2d9cc75-bcde-5f91-a58f-521245e3769d
2026-03-28 11:05:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a2d9cc75-bcde-5f91-a58f-521245e3769d, skipping ID generation
2026-03-28 11:05:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a2d9cc75-bcde-5f91-a58f-521245e3769d sending to next pipeline
2026-03-28 11:05:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a2d9cc75-bcde-5f91-a58f-521245e3769d, identifier: BF18%20ZPB
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822510/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822510>
2026-03-28 11:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794294/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794294>
2026-03-28 11:05:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719442>
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818045/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LV14AZO/42808433?sv=2020-08-04&st=2026-03-28T11%3A05%3A15Z&se=2026-03-28T11%3A30%3A15Z&sr=b&sp=r&sig=q79%2Bwje6Rp30FV1bJ7VANBzx0WW36Q2RQzHyikKt5lE%3D)
2026-03-28 11:05:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG65ETD/42807591?sv=2020-08-04&st=2026-03-28T11%3A05%3A18Z&se=2026-03-28T11%3A30%3A18Z&sr=b&sp=r&sig=Np8cFIDWj%2FiZIQVGIrPrgkly836YhumUb%2B%2BWxVOVbns%3D)
2026-03-28 11:05:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a2d9cc75-bcde-5f91-a58f-521245e3769d with identifier: BF18%20ZPB
2026-03-28 11:05:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a2d9cc75-bcde-5f91-a58f-521245e3769d with identifier: BF18%20ZPB
2026-03-28 11:05:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a2d9cc75-bcde-5f91-a58f-521245e3769d with identifier: BF18%20ZPB to the API
2026-03-28 11:05:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781995/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_expert_report_file_0c72b400-375b-4829-bebb-f057d6df868c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF18%20ZPB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a2d9cc75-bcde-5f91-a58f-521245e3769d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF18 ZPB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF18%20ZPB&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'PEUGEOT',
'model': '108',
'odometer': 28881,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44723,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698781995/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43132,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782023/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41867,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40909,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782082/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40234,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782103/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79036,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782139/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782167/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782200/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a2d9cc75-bcde-5f91-a58f-521245e3769d/a2d9cc75-bcde-5f91-a58f-521245e3769d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86786,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF18ZPB/698782222/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'PEUGEOT 108 1.2 P/T ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T ALLURE',
'vin': 'VF3PAHMTCHR314779',
'year': 2018}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520ZPB%27 HTTP/1.1" 200 None
2026-03-28 11:05:29 [bca.uk] INFO: Saving data for BF18%20ZPB: {'created_time': 1774695929.341677, 'last_price_update_time': 1774695929.341688, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF18%2520ZPB') HTTP/1.1" 204 0
2026-03-28 11:05:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e851a50>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSG64KJZ%252F698787837%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787837/600 saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a
2026-03-28 11:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e1dc24d5-e7ba-51c0-bd83-ba297100a29a, skipping ID generation
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e1dc24d5-e7ba-51c0-bd83-ba297100a29a sending to next pipeline
2026-03-28 11:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1dc24d5-e7ba-51c0-bd83-ba297100a29a, identifier: SG64%20KJZ
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c1c90>
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT62XMJ%252F698811767%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811767/600 saved to cache
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f5bb8527-4699-5922-9d9e-bf80d1714c97
2026-03-28 11:05:29 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f5bb8527-4699-5922-9d9e-bf80d1714c97, skipping ID generation
2026-03-28 11:05:29 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f5bb8527-4699-5922-9d9e-bf80d1714c97 sending to next pipeline
2026-03-28 11:05:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5bb8527-4699-5922-9d9e-bf80d1714c97, identifier: BT62%20XMJ
2026-03-28 11:05:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1dc24d5-e7ba-51c0-bd83-ba297100a29a with identifier: SG64%20KJZ
2026-03-28 11:05:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1dc24d5-e7ba-51c0-bd83-ba297100a29a with identifier: SG64%20KJZ
2026-03-28 11:05:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1dc24d5-e7ba-51c0-bd83-ba297100a29a with identifier: SG64%20KJZ to the API
2026-03-28 11:05:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787837/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_expert_report_file_9bdf4cf9-0bfc-4b7a-92f6-7e0ad72703b5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SG64%20KJZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.9L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e1dc24d5-e7ba-51c0-bd83-ba297100a29a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SG64 KJZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SG64%20KJZ&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'DACIA',
'model': 'SANDERO STEPWAY',
'odometer': 44483,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787837/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48617,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787844/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47620,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45975,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787858/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44740,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787866/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74454,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787874/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68589,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87551,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e1dc24d5-e7ba-51c0-bd83-ba297100a29a/e1dc24d5-e7ba-51c0-bd83-ba297100a29a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73808,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SG64KJZ/698787901/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'DACIA SANDERO STEPWAY 0.9 TCE 90 LAUREATE Hatchback',
'transmission': 'manual',
'trim': 'TCE 90 LAUREATE',
'vin': 'UU15SDAAC51639062',
'year': 2014}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG64%2520KJZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [bca.uk] INFO: Saving data for SG64%20KJZ: {'created_time': 1774695930.251406, 'last_price_update_time': 1774695930.251417, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SG64%2520KJZ') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5bb8527-4699-5922-9d9e-bf80d1714c97 with identifier: BT62%20XMJ
2026-03-28 11:05:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5bb8527-4699-5922-9d9e-bf80d1714c97 with identifier: BT62%20XMJ
2026-03-28 11:05:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5bb8527-4699-5922-9d9e-bf80d1714c97 with identifier: BT62%20XMJ to the API
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:30 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811767/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_expert_report_file_182e47b2-c9f4-437d-aa85-44152f2ef299.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT62%20XMJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f5bb8527-4699-5922-9d9e-bf80d1714c97',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT62 XMJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT62%20XMJ&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'KIA',
'model': 'RIO',
'odometer': 48727,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811718/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811767/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41535,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811791/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811820/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41331,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811865/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811887/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811912/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74296,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811941/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f5bb8527-4699-5922-9d9e-bf80d1714c97/f5bb8527-4699-5922-9d9e-bf80d1714c97_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79534,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT62XMJ/698811965/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'KIA RIO 1.2 1 Hatchback',
'transmission': 'manual',
'trim': '1',
'vin': 'KNADM311LD6202237',
'year': 2013}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT62%2520XMJ%27 HTTP/1.1" 200 None
2026-03-28 11:05:30 [bca.uk] INFO: Saving data for BT62%20XMJ: {'created_time': 1774695930.679059, 'last_price_update_time': 1774695930.679072, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT62%2520XMJ') HTTP/1.1" 204 0
2026-03-28 11:05:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731479/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731479>
2026-03-28 11:05:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907468>
2026-03-28 11:05:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2dd10>
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698813453%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813453/600 saved to cache
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d8f90>
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776177%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776177/600 saved to cache
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb43d0>
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLV14AZO%252F698818045%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818045/600 saved to cache
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a93f474b-9a84-5577-a127-e359e20b9ab5
2026-03-28 11:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a93f474b-9a84-5577-a127-e359e20b9ab5, skipping ID generation
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a93f474b-9a84-5577-a127-e359e20b9ab5 sending to next pipeline
2026-03-28 11:05:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a93f474b-9a84-5577-a127-e359e20b9ab5, identifier: LV14%20AZO
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4c990>
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG65ETD%252F698776272%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776272/600 saved to cache
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8b688c5d-461a-59e2-96c9-84371012ae94
2026-03-28 11:05:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8b688c5d-461a-59e2-96c9-84371012ae94, skipping ID generation
2026-03-28 11:05:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8b688c5d-461a-59e2-96c9-84371012ae94 sending to next pipeline
2026-03-28 11:05:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8b688c5d-461a-59e2-96c9-84371012ae94, identifier: NG65%20ETD
2026-03-28 11:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731502/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662010/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797555/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a93f474b-9a84-5577-a127-e359e20b9ab5 with identifier: LV14%20AZO
2026-03-28 11:05:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a93f474b-9a84-5577-a127-e359e20b9ab5 with identifier: LV14%20AZO
2026-03-28 11:05:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a93f474b-9a84-5577-a127-e359e20b9ab5 with identifier: LV14%20AZO to the API
2026-03-28 11:05:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818045/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_expert_report_file_166622ef-f02a-4b89-af07-b266ccc80be1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LV14%20AZO-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a93f474b-9a84-5577-a127-e359e20b9ab5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LV14 AZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LV14%20AZO&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 104099,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 16,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817932/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817964/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 63728,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698817989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813417/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39446,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41678,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818045/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698813480/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a93f474b-9a84-5577-a127-e359e20b9ab5/a93f474b-9a84-5577-a127-e359e20b9ab5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39751,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LV14AZO/698818060/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 VVT EXCITE Hatchback',
'transmission': 'manual',
'trim': 'VVT EXCITE',
'vin': 'W0L0SDL08E6044933',
'year': 2014}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV14%2520AZO%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [bca.uk] INFO: Saving data for LV14%20AZO: {'created_time': 1774695932.278513, 'last_price_update_time': 1774695932.278525, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LV14%2520AZO') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8b688c5d-461a-59e2-96c9-84371012ae94 with identifier: NG65%20ETD
2026-03-28 11:05:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8b688c5d-461a-59e2-96c9-84371012ae94 with identifier: NG65%20ETD
2026-03-28 11:05:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8b688c5d-461a-59e2-96c9-84371012ae94 with identifier: NG65%20ETD to the API
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776272/600>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_expert_report_file_fb896a74-55e6-40ac-8030-abf273acc2ea.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG65%20ETD-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8b688c5d-461a-59e2-96c9-84371012ae94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG65 ETD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG65%20ETD&vehicleType=*',
'listing': 'auction',
'location': 'Livingston',
'make': 'HYUNDAI',
'model': 'IX35',
'odometer': 57440,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776150/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43876,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42938,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776188/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776208/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776226/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 37160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776272/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776297/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72347,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8b688c5d-461a-59e2-96c9-84371012ae94/8b688c5d-461a-59e2-96c9-84371012ae94_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67919,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG65ETD/698776328/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'HYUNDAI IX35 2.0 CRDI SE 4WD StationWagon',
'transmission': 'automatic',
'trim': 'CRDI SE 4WD',
'vin': 'TMAJU81VSFJ794641',
'year': 2016}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG65%2520ETD%27 HTTP/1.1" 200 None
2026-03-28 11:05:32 [bca.uk] INFO: Saving data for NG65%20ETD: {'created_time': 1774695932.729381, 'last_price_update_time': 1774695932.729396, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG65%2520ETD') HTTP/1.1" 204 0
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e36d710>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794304%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794304/600 saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797549>
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794294/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822510/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae461490>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822534%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822534/600 saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4eb910>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731502%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731502/600 saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d9f10>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719455%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719455/600 saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe73cd0>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662010%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662010/600 saved to cache
2026-03-28 11:05:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:32 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39b250>
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797555%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797555/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794275/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794275>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905789>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787216/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787216>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662006/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662006>
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731479/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4ea790>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719442%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719442/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad323d90>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794294%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794294/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c3850>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822510%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822510/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822466/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822466>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731446/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731446>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797543>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907463/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907463>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719432/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719432>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794282>
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d9950>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731479%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731479/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e578d50>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907468%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907468/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905788>
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662006/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719468>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786420/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786420>
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794275/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787216/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411997>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c50d0>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662006%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662006/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719432/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822466/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786420/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731446/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac381610>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794275%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794275/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e847510>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797549%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797549/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5194d0>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905789%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905789/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdbc2d0>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787216%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787216/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794265>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662003>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787206/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787206>
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907463/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e51bf90>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719432%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719432/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e29bb90>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797543%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797543/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e511210>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822466%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822466/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e81c650>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786420%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786420/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb0410>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794282%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794282/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e81c190>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731446%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731446/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822444>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719423>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731421/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731421>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794274/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794274>
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd10790>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719468%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719468/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac48cfd0>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907463%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907463/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe6ec90>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905788%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905788/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797535/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797535>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907449/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907449>
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905786>
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:05:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719454/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719454>
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea4cd0>
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411997%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411997/600 saved to cache
2026-03-28 11:05:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787206/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786401>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794254/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794254>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc59b10>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662003%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662003/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411990/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411990>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794274/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731421/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787195/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787195>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719454/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4d0990>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794265%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794265/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797535/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907449/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd0810>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787206%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787206/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696662001>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719411>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794266>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822419>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5521d0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719423%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719423/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb7390>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822444%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822444/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731405>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907436/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907436>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794254/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411990/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e622210>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794274%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794274/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e29ab50>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731421%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731421/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8501d0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719454%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719454/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d9610>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797535%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797535/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4dac90>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907449%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907449/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786377>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787195/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905785/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905785>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797528>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719443>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787185>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794245/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SP19KZX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2994d0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786401%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786401/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2ced0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905786%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905786/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad3213d0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794254%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794254/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:34 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e36d390>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411990%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411990/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907436/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907470>
2026-03-28 11:05:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411984/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411984>
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d2350>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787195%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787195/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff814d0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794266%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794266/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff80650>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719411%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719411/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d3910>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822419%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822419/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905785/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e537950>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907436%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907436/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac42ead0>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696662001%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662001/600 saved to cache
2026-03-28 11:05:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2ff50>
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731405%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731405/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794245/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SP19KZX/42807959?sv=2020-08-04&st=2026-03-28T11%3A02%3A25Z&se=2026-03-28T11%3A27%3A25Z&sr=b&sp=r&sig=mVUVNJP4FSLMm49iwlEq9beYceNvgj6XZNlMJsa6Nms%3D)
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719401>
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822401>
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696661997>
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39a6d0>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797528%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797528/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb82f50>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719443%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719443/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffb5cd0>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905785%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905785/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794256/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794256>
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731388>
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907425/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907425>
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797525/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797525>
2026-03-28 11:05:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905783/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905783>
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411984/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9d2550>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSP19KZX%252F698794245%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794245/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 37884952-3501-544f-bd82-8874ad44a42b
2026-03-28 11:05:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 37884952-3501-544f-bd82-8874ad44a42b, skipping ID generation
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 37884952-3501-544f-bd82-8874ad44a42b sending to next pipeline
2026-03-28 11:05:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 37884952-3501-544f-bd82-8874ad44a42b, identifier: SP19%20KZX
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94afed6390>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787185%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787185/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae4626d0>
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786377%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786377/600 saved to cache
2026-03-28 11:05:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX
2026-03-28 11:05:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX
2026-03-28 11:05:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 37884952-3501-544f-bd82-8874ad44a42b with identifier: SP19%20KZX to the API
2026-03-28 11:05:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794245/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_expert_report_file_888d8ba4-b558-4471-a468-10b509f883e5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP19%20KZX-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '37884952-3501-544f-bd82-8874ad44a42b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP19 KZX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP19%20KZX&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 93964,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54903,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794245/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53250,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794254/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52109,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794275/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47882,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794287/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794293/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91067,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65228,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76149,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_37884952-3501-544f-bd82-8874ad44a42b/37884952-3501-544f-bd82-8874ad44a42b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74914,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SP19KZX/698794337/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.5 E/B 182 ST-LINE X Estate',
'transmission': 'manual',
'trim': 'E/B 182 ST-LINE X',
'vin': 'WF0PXXGCHPKK57559',
'year': 2019}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP19%2520KZX%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [bca.uk] INFO: Saving data for SP19%20KZX: {'created_time': 1774695936.293616, 'last_price_update_time': 1774695936.293628, 'auction_closing_time': 1774864800.0}
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP19%2520KZX') HTTP/1.1" 204 0
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719427>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907464>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411978>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786353>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906838/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906838>
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe5fad0>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411984%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411984/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe71e90>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907470%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907470/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794256/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787177/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NV07OAE-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696661996>
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797525/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea14790>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719401%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719401/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea8450>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696661997%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661997/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5102d0>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822401%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822401/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905783/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907425/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feabe50>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794256%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794256/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2d610>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797525%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797525/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719391>
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787177/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV07OAE/42807733?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=%2FXZlcm%2BwhqrPz3XFEhF9dO46%2FdIbkvRuEZrOjXNrXOM%3D)
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794247>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822387>
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe5f3d0>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731388%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731388/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:36 [bca.uk] INFO: Total items found: 100
2026-03-28 11:05:36 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded
2026-03-28 11:05:36 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:05:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad321290>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905783%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905783/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d1590>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786353%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786353/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb47cd0>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719427%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719427/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:05:36 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb45f50>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411978%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411978/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac436e50>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907425%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907425/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fda6450>
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907464%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907464/600 saved to cache
2026-03-28 11:05:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:05:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906838/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907409>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731373>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797520>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905782>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719409>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786334/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786334>
2026-03-28 11:05:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411973/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411973>
2026-03-28 11:05:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:36 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:36 [bca.uk] INFO: Found listing with ID: GY64%20VCN
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY64%2520VCN%27 HTTP/1.1" 200 None
2026-03-28 11:05:36 [bca.uk] INFO: Scrape type for GY64%20VCN: 1
2026-03-28 11:05:36 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN
2026-03-28 11:05:36 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:05:36 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:36 [bca.uk] INFO: Found listing with ID: VK66%20VXB
2026-03-28 11:05:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520VXB%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [bca.uk] INFO: Scrape type for VK66%20VXB: 0
2026-03-28 11:05:37 [bca.uk] INFO: Found listing with ID: LY62%20DNF
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY62%2520DNF%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [bca.uk] INFO: Scrape type for LY62%20DNF: 2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 691af02c-9bd7-5aeb-92b6-5cc0f064bb58 with identifier: LY62%20DNF
2026-03-28 11:05:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 691af02c-9bd7-5aeb-92b6-5cc0f064bb58 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 691af02c-9bd7-5aeb-92b6-5cc0f064bb58 with scrape type 2
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 691af02c-9bd7-5aeb-92b6-5cc0f064bb58, identifier: LY62%20DNF
2026-03-28 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 691af02c-9bd7-5aeb-92b6-5cc0f064bb58 with identifier: LY62%20DNF
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=purple HTTP/1.1" 200 None
2026-03-28 11:05:37 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 691af02c-9bd7-5aeb-92b6-5cc0f064bb58 with identifier: LY62%20DNF
2026-03-28 11:05:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 691af02c-9bd7-5aeb-92b6-5cc0f064bb58 with identifier: LY62%20DNF to the API
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LY62%20DNF-GB',
'category': 'Car',
'color': 'purple',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '691af02c-9bd7-5aeb-92b6-5cc0f064bb58',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LY62 DNF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LY62%20DNF&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 90129,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 1.6 TDI CR 105 ELEGANCE DSG Estate',
'transmission': 'automatic',
'trim': 'TDI CR 105 ELEGANCE DSG',
'vin': 'TMBGT21Z1D2043044',
'year': 2013}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY62%2520DNF%27 HTTP/1.1" 200 None
2026-03-28 11:05:37 [bca.uk] INFO: Saving data for LY62%20DNF: {'auction_closing_time': 1774864800.0, 'created_time': 1774015422.168865, 'last_price_update_time': 1774695937.748956}
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LY62%2520DNF') HTTP/1.1" 204 0
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d1e10>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV07OAE%252F698787177%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787177/600 saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2
2026-03-28 11:05:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2, skipping ID generation
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 sending to next pipeline
2026-03-28 11:05:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2, identifier: NV07%20OAE
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2e0d0>
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696661996%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661996/600 saved to cache
2026-03-28 11:05:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907453>
2026-03-28 11:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VK16KNM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DL64RZO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906835/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906835>
2026-03-28 11:05:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661992/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YK69PZB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794247/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:38 [bca.uk] INFO: Found listing with ID: LD62%20NNR
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [bca.uk] INFO: Scrape type for LD62%20NNR: 1
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): translate.google.com:443
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://translate.google.com:443 "GET /m?tl=en&sl=auto&q=. HTTP/1.1" 200 None
2026-03-28 11:05:38 [crawlers.pipelines.translation_pipeline] INFO: Saving translations to Azure Table Storage
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /Translations(PartitionKey='auto',RowKey='auto') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE
2026-03-28 11:05:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5a6902b6-5d4f-51c9-8498-88a7e30f04c2 with identifier: NV07%20OAE to the API
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787177/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_expert_report_file_3742f5bc-9b06-4a11-a0d2-574481f88efb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV07%20OAE-GB',
'category': 'Car',
'color': None,
'currency': 'GBP',
'doors_number': 3,
'engine': '1.1L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5a6902b6-5d4f-51c9-8498-88a7e30f04c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV07 OAE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV07%20OAE&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'MITSUBISHI',
'model': 'COLT',
'odometer': 156792,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787177/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787185/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787195/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787206/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42814,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787216/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66472,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5a6902b6-5d4f-51c9-8498-88a7e30f04c2/5a6902b6-5d4f-51c9-8498-88a7e30f04c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV07OAE/698787285/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MITSUBISHI COLT 1.1 CZ1 Hatchback',
'transmission': 'manual',
'trim': 'CZ1',
'vin': 'XMDMNZ32A7F073396',
'year': 2007}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV07%2520OAE%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [bca.uk] INFO: Saving data for NV07%20OAE: {'created_time': 1774695938.61175, 'last_price_update_time': 1774695938.611764, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV07%2520OAE') HTTP/1.1" 204 0
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6edd0>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906838%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906838/600 saved to cache
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:05:38 [bca.uk] INFO: Found listing with ID: YG10%20VAH
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG10%2520VAH%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [bca.uk] INFO: Scrape type for YG10%20VAH: 1
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8045aeca-0321-548f-849f-0212d3ae522c with identifier: YG10%20VAH
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:05:38 [bca.uk] INFO: Found listing with ID: EY63%20WHH
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520WHH%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [bca.uk] INFO: Scrape type for EY63%20WHH: 0
2026-03-28 11:05:38 [bca.uk] INFO: Found listing with ID: MF61%20FVN
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF61%2520FVN%27 HTTP/1.1" 200 None
2026-03-28 11:05:38 [bca.uk] INFO: Scrape type for MF61%20FVN: 2
2026-03-28 11:05:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7 with identifier: MF61%20FVN
2026-03-28 11:05:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7 with scrape type 2
2026-03-28 11:05:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7, identifier: MF61%20FVN
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc279d0>
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719391%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719391/600 saved to cache
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c1bd0>
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822387%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822387/600 saved to cache
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff6ced0>
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794247%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794247/600 saved to cache
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7 with identifier: MF61%20FVN
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7 with identifier: MF61%20FVN
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7 with identifier: MF61%20FVN to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF61%20FVN-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a7c13e7b-279f-5f11-8631-3a0a0e8ae0d7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF61 FVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF61%20FVN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'CITROEN',
'model': 'C4 PICASSO',
'odometer': 111078,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CITROEN C4 PICASSO 1.6 E-HDI 110 EXCLUSIVE EGS MPV',
'transmission': 'automatic',
'trim': 'E-HDI 110 EXCLUSIVE EGS',
'vin': 'VF7UD9HR8BJ725451',
'year': 2011}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF61%2520FVN%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [bca.uk] INFO: Saving data for MF61%20FVN: {'auction_closing_time': 1774864800.0, 'created_time': 1774564106.308583, 'last_price_update_time': 1774695939.549706}
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF61%2520FVN') HTTP/1.1" 204 0
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786334/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661992/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YK69PZB/42780230?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=MSEm8viHfhIneA2oytSz4UoMWJKNoNgJBRvbVbcnZ7c%3D)
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411973/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:39 [bca.uk] INFO: Found listing with ID: MT09%20FDX
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT09%2520FDX%27 HTTP/1.1" 200 None
2026-03-28 11:05:39 [bca.uk] INFO: Scrape type for MT09%20FDX: 2
2026-03-28 11:05:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2e29dc12-e88d-5249-8968-5f64d2ccb37e with identifier: MT09%20FDX
2026-03-28 11:05:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2e29dc12-e88d-5249-8968-5f64d2ccb37e with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2e29dc12-e88d-5249-8968-5f64d2ccb37e with scrape type 2
2026-03-28 11:05:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2e29dc12-e88d-5249-8968-5f64d2ccb37e, identifier: MT09%20FDX
2026-03-28 11:05:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2e29dc12-e88d-5249-8968-5f64d2ccb37e with identifier: MT09%20FDX
2026-03-28 11:05:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2e29dc12-e88d-5249-8968-5f64d2ccb37e with identifier: MT09%20FDX
2026-03-28 11:05:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2e29dc12-e88d-5249-8968-5f64d2ccb37e with identifier: MT09%20FDX to the API
2026-03-28 11:05:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT09%20FDX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '2e29dc12-e88d-5249-8968-5f64d2ccb37e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT09 FDX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT09%20FDX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 86140,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'JAGUAR XF 3.0 D V6 240 LUXURY Saloon',
'transmission': 'automatic',
'trim': 'D V6 240 LUXURY',
'vin': 'SAJAC0524AKR54554',
'year': 2009}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT09%2520FDX%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [bca.uk] INFO: Saving data for MT09%20FDX: {'auction_closing_time': 1774864800.0, 'created_time': 1774564728.647193, 'last_price_update_time': 1774695941.367435}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT09%2520FDX') HTTP/1.1" 204 0
2026-03-28 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:41 [bca.uk] INFO: Found listing with ID: PK11%20ZFG
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK11%2520ZFG%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [bca.uk] INFO: Scrape type for PK11%20ZFG: 2
2026-03-28 11:05:41 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b17eb679-6b1f-5a97-82b8-6252546d3f98 with identifier: PK11%20ZFG
2026-03-28 11:05:41 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b17eb679-6b1f-5a97-82b8-6252546d3f98 with scrape type 2
2026-03-28 11:05:41 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b17eb679-6b1f-5a97-82b8-6252546d3f98 with scrape type 2
2026-03-28 11:05:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b17eb679-6b1f-5a97-82b8-6252546d3f98, identifier: PK11%20ZFG
2026-03-28 11:05:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b17eb679-6b1f-5a97-82b8-6252546d3f98 with identifier: PK11%20ZFG
2026-03-28 11:05:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b17eb679-6b1f-5a97-82b8-6252546d3f98 with identifier: PK11%20ZFG
2026-03-28 11:05:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b17eb679-6b1f-5a97-82b8-6252546d3f98 with identifier: PK11%20ZFG to the API
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK11%20ZFG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b17eb679-6b1f-5a97-82b8-6252546d3f98',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK11 ZFG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK11%20ZFG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 72838,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 SE DSG Estate',
'transmission': 'automatic',
'trim': 'TDI 105 SE DSG',
'vin': 'WVWZZZ1KZBM691520',
'year': 2011}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK11%2520ZFG%27 HTTP/1.1" 200 None
2026-03-28 11:05:41 [bca.uk] INFO: Saving data for PK11%20ZFG: {'auction_closing_time': 1774864800.0, 'created_time': 1774564707.28014, 'last_price_update_time': 1774695941.973551}
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK11%2520ZFG') HTTP/1.1" 204 0
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fefec50>
2026-03-28 11:05:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731373%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731373/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebb3590>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786334%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786334/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4fbd10>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYK69PZB%252F696661992%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661992/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb, skipping ID generation
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46d911f3-ff5a-539c-ad76-9a1e9263ebbb sending to next pipeline
2026-03-28 11:05:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb, identifier: YK69%20PZB
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac434250>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719409%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719409/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4e550>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797520%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797520/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff9aed0>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411973%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411973/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VK16KNM/42806425?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=gbGsRFRrPYkRBHjy4WILnmCT%2BWokte65rOPR9q7AhK0%3D)
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DL64RZO/42808410?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=x%2B4J5SePZ6dSF6MAty56u5l9TVYK0Bw3ql%2BBIDtLE7s%3D)
2026-03-28 11:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY64%20VCN-GB>
2026-03-28 11:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BF62JWL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:05:42 [bca.uk] INFO: Found listing with ID: RJ57%20KKY
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ57%2520KKY%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Scrape type for RJ57%20KKY: 0
2026-03-28 11:05:42 [bca.uk] INFO: Found listing with ID: SP08%20HWJ
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520HWJ%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Scrape type for SP08%20HWJ: 0
2026-03-28 11:05:42 [bca.uk] INFO: Found listing with ID: FR62%20KCZ
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR62%2520KCZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Scrape type for FR62%20KCZ: 1
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ
2026-03-28 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:05:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB
2026-03-28 11:05:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB
2026-03-28 11:05:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46d911f3-ff5a-539c-ad76-9a1e9263ebbb with identifier: YK69%20PZB to the API
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661992/600>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_expert_report_file_da735c91-db87-407e-aacd-166971375dd5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YK69%20PZB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '46d911f3-ff5a-539c-ad76-9a1e9263ebbb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YK69 PZB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YK69%20PZB&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'JAGUAR',
'model': 'E-PACE',
'odometer': 41625,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661992/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43934,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696661997/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42163,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662003/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41194,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662006/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662010/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662016/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662019/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d911f3-ff5a-539c-ad76-9a1e9263ebbb/46d911f3-ff5a-539c-ad76-9a1e9263ebbb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89952,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YK69PZB/696662022/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'JAGUAR E-PACE 2.0 D180 AWD R-DYNAMIC SE Hatchback',
'transmission': 'automatic',
'trim': 'D180 AWD R-DYNAMIC SE',
'vin': 'SADFA2AN0L1Z80460',
'year': 2019}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK69%2520PZB%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Saving data for YK69%20PZB: {'created_time': 1774695942.84862, 'last_price_update_time': 1774695942.848633, 'auction_closing_time': 1774864800.0}
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YK69%2520PZB') HTTP/1.1" 204 0
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24e890>
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907409%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907409/600 saved to cache
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906835/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:05:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698731357>
2026-03-28 11:05:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG10%20VAH-GB>
2026-03-28 11:05:42 [bca.uk] INFO: Found listing with ID: KM66%20FHL
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM66%2520FHL%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Scrape type for KM66%20FHL: 1
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL
2026-03-28 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:05:42 [bca.uk] INFO: Found listing with ID: KY06%20TYK
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY06%2520TYK%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Scrape type for KY06%20TYK: 0
2026-03-28 11:05:42 [bca.uk] INFO: Found listing with ID: M500%20MGW
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-28 11:05:42 [bca.uk] INFO: Scrape type for M500%20MGW: 2
2026-03-28 11:05:42 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW
2026-03-28 11:05:42 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with scrape type 2
2026-03-28 11:05:42 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with scrape type 2
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c, identifier: M500%20MGW
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe29cd0>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905782%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905782/600 saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feab8d0>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVK16KNM%252F698719379%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719379/600 saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659, skipping ID generation
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 sending to next pipeline
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659, identifier: VK16%20KNM
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac381910>
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDL64RZO%252F698822368%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822368/600 saved to cache
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 89417644-08ea-5067-8a1b-e8adb9994e95
2026-03-28 11:05:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 89417644-08ea-5067-8a1b-e8adb9994e95, skipping ID generation
2026-03-28 11:05:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 89417644-08ea-5067-8a1b-e8adb9994e95 sending to next pipeline
2026-03-28 11:05:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 89417644-08ea-5067-8a1b-e8adb9994e95, identifier: DL64%20RZO
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW
2026-03-28 11:05:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 848bfd1f-ac4c-5325-bb26-788b7cc60c8c with identifier: M500%20MGW to the API
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 254,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=M500%20MGW-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 2,
'engine': '3.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '848bfd1f-ac4c-5325-bb26-788b7cc60c8c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'M500 MGW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=M500%20MGW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MERCEDES-BENZ',
'model': 'SLK 320',
'odometer': 75925,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2002-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ SLK 320 3.2 TIP Roadster',
'transmission': 'manual',
'trim': 'TIP',
'vin': 'WDB1704652F261432',
'year': 2002}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M500%2520MGW%27 HTTP/1.1" 200 None
2026-03-28 11:05:43 [bca.uk] INFO: Saving data for M500%20MGW: {'auction_closing_time': 1774778400.0, 'created_time': 1774564104.485786, 'last_price_update_time': 1774695943.769178}
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='M500%2520MGW') HTTP/1.1" 204 0
2026-03-28 11:05:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM
2026-03-28 11:05:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM
2026-03-28 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3da3388f-4da2-53d6-ab6a-d59b5b7c9659 with identifier: VK16%20KNM to the API
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719379/600>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_expert_report_file_77f226bb-9023-46a1-b9e5-ba3ff811866e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK16%20KNM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3da3388f-4da2-53d6-ab6a-d59b5b7c9659',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK16 KNM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK16%20KNM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 78000,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50114,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49452,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45022,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43091,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719432/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83266,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719442/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78890,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83233,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3da3388f-4da2-53d6-ab6a-d59b5b7c9659/3da3388f-4da2-53d6-ab6a-d59b5b7c9659_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80197,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VK16KNM/698719483/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.4 T 16V 150 SRI Hatchback',
'transmission': 'automatic',
'trim': 'T 16V 150 SRI',
'vin': 'W0LBF6EC3GG083744',
'year': 2016}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520KNM%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [bca.uk] INFO: Saving data for VK16%20KNM: {'created_time': 1774695944.329374, 'last_price_update_time': 1774695944.329385, 'auction_closing_time': 1774864800.0}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK16%2520KNM') HTTP/1.1" 204 0
2026-03-28 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 89417644-08ea-5067-8a1b-e8adb9994e95 with identifier: DL64%20RZO
2026-03-28 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 89417644-08ea-5067-8a1b-e8adb9994e95 with identifier: DL64%20RZO
2026-03-28 11:05:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 89417644-08ea-5067-8a1b-e8adb9994e95 with identifier: DL64%20RZO to the API
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822368/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_expert_report_file_3abb1ae4-038d-4f6a-b91f-14168c273297.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DL64%20RZO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '89417644-08ea-5067-8a1b-e8adb9994e95',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DL64 RZO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DL64%20RZO&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 175221,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44150,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822466/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822510/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55346,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95726,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_89417644-08ea-5067-8a1b-e8adb9994e95/89417644-08ea-5067-8a1b-e8adb9994e95_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DL64RZO/698822578/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SRI Hatchback',
'transmission': 'manual',
'trim': '16V SRI',
'vin': 'W0L0SDL08E6102104',
'year': 2014}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520RZO%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [bca.uk] INFO: Saving data for DL64%20RZO: {'created_time': 1774695944.744152, 'last_price_update_time': 1774695944.744165, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DL64%2520RZO') HTTP/1.1" 204 0
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907399>
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905780>
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797512/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797512>
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD62%20NNR-GB>
2026-03-28 11:05:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BF62JWL/42807961?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=RJ%2FxEbO5km%2FJwTpWD6CI81iH%2FoBqtHQzZju477Fqjto%3D)
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719399>
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786321>
2026-03-28 11:05:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411970>
2026-03-28 11:05:44 [bca.uk] INFO: Found listing with ID: MD07%20PTY
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD07%2520PTY%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [bca.uk] INFO: Scrape type for MD07%20PTY: 0
2026-03-28 11:05:44 [bca.uk] INFO: Found listing with ID: MF10%20UFT
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF10%2520UFT%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [bca.uk] INFO: Scrape type for MF10%20UFT: 0
2026-03-28 11:05:44 [bca.uk] INFO: Found listing with ID: MF17%20NRO
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF17%2520NRO%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [bca.uk] INFO: Scrape type for MF17%20NRO: 1
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 30856a3b-be0e-5168-89b3-4f62e251696e with identifier: MF17%20NRO
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:05:44 [bca.uk] INFO: Found listing with ID: MK62%20DZU
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK62%2520DZU%27 HTTP/1.1" 200 None
2026-03-28 11:05:44 [bca.uk] INFO: Scrape type for MK62%20DZU: 2
2026-03-28 11:05:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 43127bbb-45da-5c80-a0cb-bdc250800a24 with identifier: MK62%20DZU
2026-03-28 11:05:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 43127bbb-45da-5c80-a0cb-bdc250800a24 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 43127bbb-45da-5c80-a0cb-bdc250800a24 with scrape type 2
2026-03-28 11:05:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 43127bbb-45da-5c80-a0cb-bdc250800a24, identifier: MK62%20DZU
2026-03-28 11:05:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 43127bbb-45da-5c80-a0cb-bdc250800a24 with identifier: MK62%20DZU
2026-03-28 11:05:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 43127bbb-45da-5c80-a0cb-bdc250800a24 with identifier: MK62%20DZU
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 43127bbb-45da-5c80-a0cb-bdc250800a24 with identifier: MK62%20DZU to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK62%20DZU-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '43127bbb-45da-5c80-a0cb-bdc250800a24',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MK62 DZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK62%20DZU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'CITROEN',
'model': 'C1',
'odometer': 86250,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 VTR Hatchback',
'transmission': 'manual',
'trim': 'VTR',
'vin': 'VF7PMCFB4CR509973',
'year': 2012}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK62%2520DZU%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [bca.uk] INFO: Saving data for MK62%20DZU: {'auction_closing_time': 1774778400.0, 'created_time': 1774476402.210784, 'last_price_update_time': 1774695945.384409}
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK62%2520DZU') HTTP/1.1" 204 0
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae8c3750>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906835%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906835/600 saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eab0ad0>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907453%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907453/600 saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907441/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907441>
2026-03-28 11:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907391/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907391>
2026-03-28 11:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906833/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906833>
2026-03-28 11:05:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR62%20KCZ-GB>
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT16TPO/42806593?sv=2020-08-04&st=2026-03-28T11%3A02%3A24Z&se=2026-03-28T11%3A27%3A24Z&sr=b&sp=r&sig=petUN94wdhLaBOHSBKk3SGWsk%2Fp7dOzf8bLXv2AGq6Q%3D)
2026-03-28 11:05:45 [bca.uk] INFO: Found listing with ID: YH09%20BCO
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520BCO%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [bca.uk] INFO: Scrape type for YH09%20BCO: 1
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO
2026-03-28 11:05:45 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:05:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad18dcd0>
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBF62JWL%252F698794241%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794241/600 saved to cache
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9ee147d-a1ed-542d-93b8-9e136eeb16c2, skipping ID generation
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9ee147d-a1ed-542d-93b8-9e136eeb16c2 sending to next pipeline
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a9ee147d-a1ed-542d-93b8-9e136eeb16c2, identifier: BF62%20JWL
2026-03-28 11:05:45 [bca.uk] INFO: Found listing with ID: BJ10%20UWH
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-28 11:05:45 [bca.uk] INFO: Scrape type for BJ10%20UWH: 2
2026-03-28 11:05:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH
2026-03-28 11:05:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with scrape type 2
2026-03-28 11:05:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef, identifier: BJ10%20UWH
2026-03-28 11:05:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL
2026-03-28 11:05:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL
2026-03-28 11:05:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a9ee147d-a1ed-542d-93b8-9e136eeb16c2 with identifier: BF62%20JWL to the API
2026-03-28 11:05:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794241/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_expert_report_file_561704b1-d1d6-4809-8079-72418bb863c5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF62%20JWL-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a9ee147d-a1ed-542d-93b8-9e136eeb16c2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF62 JWL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF62%20JWL&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 78299,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794247/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45521,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794256/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46845,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44768,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794274/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94689,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794294/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74038,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84045,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794315/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9ee147d-a1ed-542d-93b8-9e136eeb16c2/a9ee147d-a1ed-542d-93b8-9e136eeb16c2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BF62JWL/698794324/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.4 MATCH Hatchback',
'transmission': 'manual',
'trim': 'MATCH',
'vin': 'WVWZZZ6RZDU006111',
'year': 2012}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF62%2520JWL%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [bca.uk] INFO: Saving data for BF62%20JWL: {'created_time': 1774695946.228848, 'last_price_update_time': 1774695946.228861, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF62%2520JWL') HTTP/1.1" 204 0
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797512/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH
2026-03-28 11:05:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef with identifier: BJ10%20UWH to the API
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 210,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BJ10%20UWH-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd4e14a0b-5fe4-5927-a9a5-8ae14e88c6ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BJ10 UWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BJ10%20UWH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 73388,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 2.0 CRDI 138 XS 2WD StationWagon',
'transmission': 'automatic',
'trim': 'CRDI 138 XS 2WD',
'vin': 'U6YKH815MAL097622',
'year': 2010}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ10%2520UWH%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [bca.uk] INFO: Saving data for BJ10%20UWH: {'auction_closing_time': 1774778400.0, 'created_time': 1774188706.75009, 'last_price_update_time': 1774695946.642413}
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BJ10%2520UWH') HTTP/1.1" 204 0
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:46 [bca.uk] INFO: Found listing with ID: MM69%20SVE
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM69%2520SVE%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [bca.uk] INFO: Scrape type for MM69%20SVE: 0
2026-03-28 11:05:46 [bca.uk] INFO: Found listing with ID: KW19%20WVM
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW19%2520WVM%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [bca.uk] INFO: Scrape type for KW19%20WVM: 0
2026-03-28 11:05:46 [bca.uk] INFO: Found listing with ID: NY19%20XSW
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY19%2520XSW%27 HTTP/1.1" 200 None
2026-03-28 11:05:46 [bca.uk] INFO: Scrape type for NY19%20XSW: 1
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW
2026-03-28 11:05:46 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d4350>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411970%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411970/600 saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3820d0>
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT16TPO%252F698731357%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731357/600 saved to cache
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 38d36d03-f942-5838-98e9-4f1c879172c5
2026-03-28 11:05:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 38d36d03-f942-5838-98e9-4f1c879172c5, skipping ID generation
2026-03-28 11:05:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 38d36d03-f942-5838-98e9-4f1c879172c5 sending to next pipeline
2026-03-28 11:05:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 38d36d03-f942-5838-98e9-4f1c879172c5, identifier: BT16%20TPO
2026-03-28 11:05:46 [bca.uk] INFO: Total items found: 100
2026-03-28 11:05:46 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded
2026-03-28 11:05:46 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:05:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 38d36d03-f942-5838-98e9-4f1c879172c5 with identifier: BT16%20TPO
2026-03-28 11:05:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 38d36d03-f942-5838-98e9-4f1c879172c5 with identifier: BT16%20TPO
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 38d36d03-f942-5838-98e9-4f1c879172c5 with identifier: BT16%20TPO to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731357/600>
{'auction_title': '',
'c_o_2_emission_value': 89,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_expert_report_file_9bb25167-d266-4785-b2c0-5cf2b896232f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT16%20TPO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '38d36d03-f942-5838-98e9-4f1c879172c5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT16 TPO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT16%20TPO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VOLVO',
'model': 'V40',
'odometer': 102387,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731338/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48937,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46724,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47781,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41872,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731421/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76730,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731446/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731479/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83863,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_38d36d03-f942-5838-98e9-4f1c879172c5/38d36d03-f942-5838-98e9-4f1c879172c5_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77719,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT16TPO/698731515/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLVO V40 2.0 D2 120 MOMENTUM Hatchback',
'transmission': 'manual',
'trim': 'D2 120 MOMENTUM',
'vin': 'YV1MV74L1H2371938',
'year': 2016}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT16%2520TPO%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Saving data for BT16%20TPO: {'created_time': 1774695947.338412, 'last_price_update_time': 1774695947.338426, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT16%2520TPO') HTTP/1.1" 204 0
2026-03-28 11:05:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:47 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: OV20%20OKU
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV20%2520OKU%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for OV20%20OKU: 0
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: FD21%20HBN
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD21%2520HBN%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for FD21%20HBN: 0
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: DP21%20OWH
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP21%2520OWH%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for DP21%20OWH: 1
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: KR61%20ECC
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR61%2520ECC%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for KR61%20ECC: 0
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: CY13%20EPU
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CY13%2520EPU%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for CY13%20EPU: 0
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: NV21%20YRL
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520YRL%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for NV21%20YRL: 1
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 315975b4-353c-5208-8d12-be9533c8f6fb with identifier: NV21%20YRL
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:05:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c0710>
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797512%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797512/600 saved to cache
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac103ad0>
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719399%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719399/600 saved to cache
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb9ba10>
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786321%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786321/600 saved to cache
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM66%20FHL-GB>
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: WO18%20YOD
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO18%2520YOD%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for WO18%20YOD: 1
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:05:47 [bca.uk] INFO: Found listing with ID: EN68%20PKU
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN68%2520PKU%27 HTTP/1.1" 200 None
2026-03-28 11:05:47 [bca.uk] INFO: Scrape type for EN68%20PKU: 2
2026-03-28 11:05:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f5ccd6f4-5821-546e-a101-3174269baae6 with identifier: EN68%20PKU
2026-03-28 11:05:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f5ccd6f4-5821-546e-a101-3174269baae6 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f5ccd6f4-5821-546e-a101-3174269baae6 with scrape type 2
2026-03-28 11:05:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f5ccd6f4-5821-546e-a101-3174269baae6, identifier: EN68%20PKU
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907391/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EA08SVO/42809434?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=l5UI9J7yUF5jCJ5dp669a8SCXsYiDkYPMpbluPbjIJ0%3D)
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906833/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:05:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907441/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:05:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f5ccd6f4-5821-546e-a101-3174269baae6 with identifier: EN68%20PKU
2026-03-28 11:05:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f5ccd6f4-5821-546e-a101-3174269baae6 with identifier: EN68%20PKU
2026-03-28 11:05:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f5ccd6f4-5821-546e-a101-3174269baae6 with identifier: EN68%20PKU to the API
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EN68%20PKU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f5ccd6f4-5821-546e-a101-3174269baae6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EN68 PKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EN68%20PKU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 51146,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD FOCUS 2.0 EBL 150 ST-LINE X Estate',
'transmission': 'manual',
'trim': 'EBL 150 ST-LINE X',
'vin': 'WF0PXXGCHPJB58481',
'year': 2018}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN68%2520PKU%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [bca.uk] INFO: Saving data for EN68%20PKU: {'auction_closing_time': 1774951200.0, 'created_time': 1774391581.496149, 'last_price_update_time': 1774695948.084421}
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EN68%2520PKU') HTTP/1.1" 204 0
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e6218d0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_expert_report_file_fdeda8f1-38b5-44c4-ad09-60048656dd4a.pdf HTTP/1.1" 201 0
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a810a8a8-d5e9-52db-8f4f-157b36d1163d, skipping ID generation
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGY64VCN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GY64VCN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95f7d0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_expert_report_file_5c4c7940-b947-49f6-8fc3-d9e2bd4f2971.pdf HTTP/1.1" 201 0
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8045aeca-0321-548f-849f-0212d3ae522c, skipping ID generation
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYG10VAH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG10VAH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff75410>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905780%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905780/600 saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95cdd0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907399%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907399/600 saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF17%20NRO-GB>
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797507/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797507>
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH09%20BCO-GB>
2026-03-28 11:05:48 [bca.uk] INFO: Found listing with ID: MA17%20CVN
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA17%2520CVN%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [bca.uk] INFO: Scrape type for MA17%20CVN: 1
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc26d888-e1c0-5316-bed2-e9f8b9e59c12 with identifier: MA17%20CVN
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:05:48 [bca.uk] INFO: Found listing with ID: YF18%20DCZ
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF18%2520DCZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [bca.uk] INFO: Scrape type for YF18%20DCZ: 1
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 67600ccf-1252-5a76-8f87-7b1e24436699 with identifier: YF18%20DCZ
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:05:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796739%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796739 not downloaded yet
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817942%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817942 not downloaded yet
2026-03-28 11:05:48 [bca.uk] INFO: Found listing with ID: MJ15%20AVR
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ15%2520AVR%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [bca.uk] INFO: Scrape type for MJ15%20AVR: 2
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f362ec0a-158d-564f-ba25-56a3f050a098 with identifier: MJ15%20AVR
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f362ec0a-158d-564f-ba25-56a3f050a098 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f362ec0a-158d-564f-ba25-56a3f050a098 with scrape type 2
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f362ec0a-158d-564f-ba25-56a3f050a098, identifier: MJ15%20AVR
2026-03-28 11:05:48 [bca.uk] INFO: Found listing with ID: NS16%20AHS
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NS16%2520AHS%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [bca.uk] INFO: Scrape type for NS16%20AHS: 1
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a9295467-dc05-5a7c-8170-d45a3e57c067 with identifier: NS16%20AHS
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2e8d0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_expert_report_file_b494ec4b-7f58-4282-8a68-88e6d8680ca8.pdf HTTP/1.1" 201 0
2026-03-28 11:05:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac, skipping ID generation
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD62NNR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD62NNR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e89fcd0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEA08SVO%252F698907391%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907391/600 saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 635e2677-2002-50d0-a57a-a285b9386cd8
2026-03-28 11:05:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 635e2677-2002-50d0-a57a-a285b9386cd8, skipping ID generation
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 635e2677-2002-50d0-a57a-a285b9386cd8 sending to next pipeline
2026-03-28 11:05:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 635e2677-2002-50d0-a57a-a285b9386cd8, identifier: EA08%20SVO
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae782090>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906833%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906833/600 saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb710d0>
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907441%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907441/600 saved to cache
2026-03-28 11:05:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719380/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719380>
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411965>
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786299/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786299>
2026-03-28 11:05:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905779/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698905779>
2026-03-28 11:05:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f362ec0a-158d-564f-ba25-56a3f050a098 with identifier: MJ15%20AVR
2026-03-28 11:05:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f362ec0a-158d-564f-ba25-56a3f050a098 with identifier: MJ15%20AVR
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f362ec0a-158d-564f-ba25-56a3f050a098 with identifier: MJ15%20AVR to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ15%20AVR-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f362ec0a-158d-564f-ba25-56a3f050a098',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MJ15 AVR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ15%20AVR&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'AUDI',
'model': 'A1 SPORTBACK',
'odometer': 40062,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'AUDI A1 SPORTBACK 1.6 TDI 116 SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': 'TDI 116 SPORT S-T',
'vin': 'WAUZZZ8X9FB016582',
'year': 2015}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ15%2520AVR%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [bca.uk] INFO: Saving data for MJ15%20AVR: {'auction_closing_time': 1774778400.0, 'created_time': 1774592214.489259, 'last_price_update_time': 1774695949.315794}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ15%2520AVR') HTTP/1.1" 204 0
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796750%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796750 not downloaded yet
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817969%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817969 not downloaded yet
2026-03-28 11:05:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 635e2677-2002-50d0-a57a-a285b9386cd8 with identifier: EA08%20SVO
2026-03-28 11:05:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 635e2677-2002-50d0-a57a-a285b9386cd8 with identifier: EA08%20SVO
2026-03-28 11:05:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 635e2677-2002-50d0-a57a-a285b9386cd8 with identifier: EA08%20SVO to the API
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907391/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_expert_report_file_d3a04810-2fe8-4de2-9952-d3286a585dd5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA08%20SVO-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '635e2677-2002-50d0-a57a-a285b9386cd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA08 SVO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA08%20SVO&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 118647,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173732,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907384/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 188994,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907391/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 185307,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182204,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907425/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907436/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907449/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157687,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907463/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_635e2677-2002-50d0-a57a-a285b9386cd8/635e2677-2002-50d0-a57a-a285b9386cd8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 160234,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EA08SVO/698907468/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.2 STYLE CLIMATE Hatchback',
'transmission': 'manual',
'trim': 'STYLE CLIMATE',
'vin': 'WF0DXXGAJD8G87459',
'year': 2008}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA08%2520SVO%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [bca.uk] INFO: Saving data for EA08%20SVO: {'created_time': 1774695949.818291, 'last_price_update_time': 1774695949.818303, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA08%2520SVO') HTTP/1.1" 204 0
2026-03-28 11:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NY19%20XSW-GB>
2026-03-28 11:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907426>
2026-03-28 11:05:49 [bca.uk] INFO: Found listing with ID: SN66%20TXZ
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520TXZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [bca.uk] INFO: Scrape type for SN66%20TXZ: 1
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:05:49 [bca.uk] INFO: Found listing with ID: LT13%20WRU
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT13%2520WRU%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [bca.uk] INFO: Scrape type for LT13%20WRU: 1
2026-03-28 11:05:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 560ed465-d714-5f9f-9fcb-eeca023ff2cc with identifier: LT13%20WRU
2026-03-28 11:05:49 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817940%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817940 not downloaded yet
2026-03-28 11:05:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV21%20YRL-GB>
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796759%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796759 not downloaded yet
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818004%27 HTTP/1.1" 200 None
2026-03-28 11:05:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818004 not downloaded yet
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea48250>
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_expert_report_file_ebbb64b9-b206-4a12-be61-d70d3d373822.pdf HTTP/1.1" 201 0
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 060f8cd0-4649-57d3-b26d-21ea2185aa7d, skipping ID generation
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFR62KCZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FR62KCZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: BN02%20DLN
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN02%2520DLN%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for BN02%20DLN: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63 with identifier: BN02%20DLN
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: FY65%20BZP
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520BZP%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for FY65%20BZP: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0b0df2fc-e1e2-543c-aac0-0c570961652c with identifier: FY65%20BZP
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817962%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817962 not downloaded yet
2026-03-28 11:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906830>
2026-03-28 11:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP21%20OWH-GB>
2026-03-28 11:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698719371>
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796769%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796769 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818025%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818025 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814001%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814001 not downloaded yet
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: EF66%20URS
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF66%2520URS%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for EF66%20URS: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 55ea19b8-9abe-5537-af8c-51406928956c with identifier: EF66%20URS
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: FX15%20VFY
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX15%2520VFY%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for FX15%20VFY: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75bdd3e7-038e-5007-9137-32beb11d671f with identifier: FX15%20VFY
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817988%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817988 not downloaded yet
2026-03-28 11:05:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF18%20DCZ-GB>
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797507/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN14XMR/42807390?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=UOAgPpiEg4FJ8y2o3ZFJFvpsXLHGXEDKm9aouQBkYrY%3D)
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796781%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796781 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818047%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818047 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814015%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814015 not downloaded yet
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: LB17%20HFF
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB17%2520HFF%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for LB17%20HFF: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 427eeecf-7f92-56d7-881b-e7294fabcb41 with identifier: LB17%20HFF
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: FM03%20CCZ
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM03%2520CCZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for FM03%20CCZ: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818009%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818009 not downloaded yet
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786299/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796796%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796796 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818072%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818072 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814035%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814035 not downloaded yet
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: PF66%20DZV
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF66%2520DZV%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for PF66%20DZV: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: FA17%20TWN
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA17%2520TWN%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for FA17%20TWN: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818036%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818036 not downloaded yet
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905779/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/AE06HAU/42809423?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=ulRufr0kSwsG7yMvG2VrHzvEjN98e2ewQxd0RJQtI9I%3D)
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719380/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796812%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796812 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818100%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818100 not downloaded yet
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814050%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814050 not downloaded yet
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf8950>
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_expert_report_file_9b899e2a-ba34-4a58-bced-2de108a87cd4.pdf HTTP/1.1" 201 0
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1dbde14-933f-5ed8-827d-25216bd45d38, skipping ID generation
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM66FHL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM66FHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea2ee10>
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN14XMR%252F698797507%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797507/600 saved to cache
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8add0ce3-3dfb-5144-93ab-96b2c1497c86, skipping ID generation
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8add0ce3-3dfb-5144-93ab-96b2c1497c86 sending to next pipeline
2026-03-28 11:05:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8add0ce3-3dfb-5144-93ab-96b2c1497c86, identifier: SN14%20XMR
2026-03-28 11:05:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PX72KYH/42806400?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=2R8H0lc4KPNFgQKyXibAYOFg%2FbxAGAAagmd6mYnOGzI%3D)
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: EK10%20VKV
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK10%2520VKV%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for EK10%20VKV: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3432e69a-fc31-5aa0-a769-766a4874750d with identifier: EK10%20VKV
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:05:50 [bca.uk] INFO: Found listing with ID: WF66%20WCL
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF66%2520WCL%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [bca.uk] INFO: Scrape type for WF66%20WCL: 1
2026-03-28 11:05:50 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL
2026-03-28 11:05:50 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818063%27 HTTP/1.1" 200 None
2026-03-28 11:05:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818063 not downloaded yet
2026-03-28 11:05:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR
2026-03-28 11:05:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR
2026-03-28 11:05:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8add0ce3-3dfb-5144-93ab-96b2c1497c86 with identifier: SN14%20XMR to the API
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:51 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797507/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_expert_report_file_cf8267ca-5956-4d6a-ba4f-8334143547fc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN14%20XMR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8add0ce3-3dfb-5144-93ab-96b2c1497c86',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN14 XMR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN14%20XMR&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'CHEVROLET',
'model': 'SPARK',
'odometer': 40443,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797502/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44637,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797507/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797512/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44896,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39672,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797525/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38456,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797535/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8add0ce3-3dfb-5144-93ab-96b2c1497c86/8add0ce3-3dfb-5144-93ab-96b2c1497c86_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN14XMR/698797555/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'CHEVROLET SPARK 1.0 LS Hatchback',
'transmission': 'manual',
'trim': 'LS',
'vin': 'KL1MF4819EC426657',
'year': 2014}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN14%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 11:05:51 [bca.uk] INFO: Saving data for SN14%20XMR: {'created_time': 1774695951.874337, 'last_price_update_time': 1774695951.874348, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN14%2520XMR') HTTP/1.1" 204 0
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796842%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796842 not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818129%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818129 not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814071%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814071 not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296332%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296332 not downloaded yet
2026-03-28 11:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814001>
2026-03-28 11:05:52 [bca.uk] INFO: Found listing with ID: GR55%20ULB
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR55%2520ULB%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [bca.uk] INFO: Scrape type for GR55%20ULB: 1
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: caf399da-ba62-5f8c-8c9c-a7254fd592b8 with identifier: GR55%20ULB
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:05:52 [bca.uk] INFO: Found listing with ID: PJ64%20LVP
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ64%2520LVP%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [bca.uk] INFO: Scrape type for PJ64%20LVP: 1
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818088%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818088 not downloaded yet
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e863bd0>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786299%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786299/600 saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a79d0>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411965%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411965/600 saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2dc6d0>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_expert_report_file_8f1f44b4-4e25-4ef2-a6d0-d3c7d0c24879.pdf HTTP/1.1" 201 0
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d1fbca2-7850-5db9-a352-21626963fd57, skipping ID generation
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYH09BCO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH09BCO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2deb90>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_expert_report_file_6c0a7081-a1b2-4262-9e90-11a935ce82c7.pdf HTTP/1.1" 201 0
2026-03-28 11:05:52 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30856a3b-be0e-5168-89b3-4f62e251696e, skipping ID generation
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF17NRO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF17NRO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a5310>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FAE06HAU%252F698905779%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905779/600 saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55f920ab-4050-5691-ad66-7855c10b1d1d
2026-03-28 11:05:52 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55f920ab-4050-5691-ad66-7855c10b1d1d, skipping ID generation
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55f920ab-4050-5691-ad66-7855c10b1d1d sending to next pipeline
2026-03-28 11:05:52 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55f920ab-4050-5691-ad66-7855c10b1d1d, identifier: AE06%20HAU
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e893b50>
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719380%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719380/600 saved to cache
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818025/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818025>
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698796862%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796862 not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818156%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818156 not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814108%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814108 not downloaded yet
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296344%27 HTTP/1.1" 200 None
2026-03-28 11:05:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296344 not downloaded yet
2026-03-28 11:05:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU
2026-03-28 11:05:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU
2026-03-28 11:05:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55f920ab-4050-5691-ad66-7855c10b1d1d with identifier: AE06%20HAU to the API
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905779/600>
{'auction_title': '',
'c_o_2_emission_value': 168,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_expert_report_file_a4478f18-82ae-44d3-88b3-06e530cfd3a7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AE06%20HAU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55f920ab-4050-5691-ad66-7855c10b1d1d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AE06 HAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AE06%20HAU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'ROVER',
'model': '45',
'odometer': 74159,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905777/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 199118,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905779/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 192282,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905780/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 198048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905783/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 165547,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905785/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 173284,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 141518,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55f920ab-4050-5691-ad66-7855c10b1d1d/55f920ab-4050-5691-ad66-7855c10b1d1d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 159834,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/AE06HAU/698905789/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'ROVER 45 1.4 GLI Hatchback',
'transmission': 'manual',
'trim': 'GLI',
'vin': 'SARRTPWBB5D656282',
'year': 2006}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE06%2520HAU%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [bca.uk] INFO: Saving data for AE06%20HAU: {'created_time': 1774695953.015994, 'last_price_update_time': 1774695953.016008, 'auction_closing_time': 1774778400.0}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AE06%2520HAU') HTTP/1.1" 204 0
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:05:53 [bca.uk] INFO: Found listing with ID: ML11%20YCS
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML11%2520YCS%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [bca.uk] INFO: Scrape type for ML11%20YCS: 1
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b24e560b-d815-5611-8097-f663470ed43b with identifier: ML11%20YCS
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:05:53 [bca.uk] INFO: Found listing with ID: KP69%20DTN
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520DTN%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [bca.uk] INFO: Scrape type for KP69%20DTN: 1
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818112%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818112 not downloaded yet
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302444%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302444 not downloaded yet
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240918%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240918 not downloaded yet
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac368050>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPX72KYH%252F698719371%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719371/600 saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item e6385dff-e339-5db1-941b-499da54c4996
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: e6385dff-e339-5db1-941b-499da54c4996, skipping ID generation
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item e6385dff-e339-5db1-941b-499da54c4996 sending to next pipeline
2026-03-28 11:05:53 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e6385dff-e339-5db1-941b-499da54c4996, identifier: PX72%20KYH
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818047/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818047>
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814015>
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814144%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814144 not downloaded yet
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296352%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296352 not downloaded yet
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:05:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH
2026-03-28 11:05:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH
2026-03-28 11:05:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e6385dff-e339-5db1-941b-499da54c4996 with identifier: PX72%20KYH to the API
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719371/600>
{'auction_title': '',
'c_o_2_emission_value': 170,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_expert_report_file_9045c3ce-c58c-44fa-81f6-3c4f57f0d0a3.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PX72%20KYH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e6385dff-e339-5db1-941b-499da54c4996',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PX72 KYH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PX72%20KYH&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'JAGUAR',
'model': 'F-PACE',
'odometer': 38052,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719380/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40559,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38528,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719427/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84277,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719454/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_e6385dff-e339-5db1-941b-499da54c4996/e6385dff-e339-5db1-941b-499da54c4996_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PX72KYH/698719468/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'JAGUAR F-PACE 2.0 D200 AWD R-DYNAMIC SE StationWagon',
'transmission': 'automatic',
'trim': 'D200 AWD R-DYNAMIC SE',
'vin': 'SADCA2AN1PA712011',
'year': 2022}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX72%2520KYH%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [bca.uk] INFO: Saving data for PX72%20KYH: {'created_time': 1774695953.778058, 'last_price_update_time': 1774695953.778069, 'auction_closing_time': 1774951200.0}
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PX72%2520KYH') HTTP/1.1" 204 0
2026-03-28 11:05:53 [bca.uk] INFO: Found listing with ID: BD66%20EUB
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD66%2520EUB%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [bca.uk] INFO: Scrape type for BD66%20EUB: 1
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 79920aac-a0d8-5e9e-8565-6a33b873ebb2 with identifier: BD66%20EUB
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:05:53 [bca.uk] INFO: Found listing with ID: KM14%20HWD
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520HWD%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [bca.uk] INFO: Scrape type for KM14%20HWD: 1
2026-03-28 11:05:53 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD
2026-03-28 11:05:53 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818137%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818137 not downloaded yet
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302450%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302450 not downloaded yet
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240922%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240922 not downloaded yet
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796796>
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818036/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818036>
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818072>
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814035/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814035>
2026-03-28 11:05:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818009/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818009>
2026-03-28 11:05:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814176%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814176 not downloaded yet
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296357%27 HTTP/1.1" 200 None
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296357 not downloaded yet
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5d4850>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907426%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907426/600 saved to cache
2026-03-28 11:05:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd04d10>
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_expert_report_file_2633d90f-2096-4c70-ae7a-cbead1af4fd9.pdf HTTP/1.1" 201 0
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 315975b4-353c-5208-8d12-be9533c8f6fb, skipping ID generation
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNV21YRL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NV21YRL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb9bb90>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_expert_report_file_7ee76f5d-b762-4636-a222-7897f8e5b690.pdf HTTP/1.1" 201 0
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20371ec6-8910-5760-a0a1-418fe02be3ea, skipping ID generation
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNY19XSW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NY19XSW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95ec50>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906830%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906830/600 saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3c410>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_expert_report_file_5df941cd-1fd2-4a87-8a7f-8b555dbdcb9a.pdf HTTP/1.1" 201 0
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9193af3e-cf78-59fe-adc3-c5316e575c5a, skipping ID generation
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDP21OWH-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP21OWH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eac9890>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_expert_report_file_8587a7f4-6c85-4846-a92b-409e403ed128.pdf HTTP/1.1" 201 0
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67600ccf-1252-5a76-8f87-7b1e24436699, skipping ID generation
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYF18DCZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YF18DCZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:05:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818063/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818063>
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: LD65%20HPZ
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD65%2520HPZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for LD65%20HPZ: 1
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6183ae08-4168-54ba-9249-65d4fca6cc28 with identifier: LD65%20HPZ
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: DX65%20UOP
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX65%2520UOP%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for DX65%20UOP: 1
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302455%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302455 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240927%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240927 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814208%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814208 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296368%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296368 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147470%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147470 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822426%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822426 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818249%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818249 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794238%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794238 not downloaded yet
2026-03-28 11:05:54 [bca.uk] INFO: Total items found: 100
2026-03-28 11:05:54 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded
2026-03-28 11:05:54 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:05:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: NV64%20RDZ
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV64%2520RDZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for NV64%20RDZ: 1
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 84d34793-f006-56e8-8992-e370c8ef535e with identifier: NV64%20RDZ
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: BD13%20YCM
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520YCM%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for BD13%20YCM: 1
2026-03-28 11:05:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM
2026-03-28 11:05:54 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302459%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302459 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240930%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240930 not downloaded yet
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffad990>
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814001%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814001/600 saved to cache
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:05:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:54 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296378%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296378 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147475%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147475 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822443%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822443 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818273%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818273 not downloaded yet
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794244%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794244 not downloaded yet
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: YC10%20PAO
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520PAO%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for YC10%20PAO: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: OV22%20RZK
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV22%2520RZK%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for OV22%20RZK: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: WN20%20RBX
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN20%2520RBX%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for WN20%20RBX: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: OF07%20ELF
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OF07%2520ELF%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for OF07%20ELF: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: EK16%20AKU
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK16%2520AKU%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for EK16%20AKU: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: RA65%20VLP
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA65%2520VLP%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for RA65%20VLP: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: ST14%20JVM
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST14%2520JVM%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for ST14%20JVM: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: CT59%20HCD
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT59%2520HCD%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for CT59%20HCD: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: EG11%20AZX
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG11%2520AZX%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for EG11%20AZX: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: OV17%20YPT
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV17%2520YPT%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for OV17%20YPT: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: BK07%20WOX
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK07%2520WOX%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for BK07%20WOX: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: SC23%20WCG
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC23%2520WCG%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for SC23%20WCG: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: WA21%20MYD
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA21%2520MYD%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for WA21%20MYD: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: WF22%20CPZ
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF22%2520CPZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for WF22%20CPZ: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: CE24%20ONH
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE24%2520ONH%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for CE24%20ONH: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: WA66%20WEK
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA66%2520WEK%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for WA66%20WEK: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: WO21%20BSX
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO21%2520BSX%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for WO21%20BSX: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: X576%20NUB
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X576%2520NUB%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for X576%20NUB: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: AE02%20ETE
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE02%2520ETE%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for AE02%20ETE: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: KM65%20UHD
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM65%2520UHD%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for KM65%20UHD: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: NY11%20YZP
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY11%2520YZP%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for NY11%20YZP: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: EA11%20ULT
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA11%2520ULT%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for EA11%20ULT: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: OU52%20XKA
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU52%2520XKA%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for OU52%20XKA: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: PJ09%20HHE
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ09%2520HHE%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for PJ09%20HHE: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: YF21%20WVG
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF21%2520WVG%27 HTTP/1.1" 200 None
2026-03-28 11:05:54 [bca.uk] INFO: Scrape type for YF21%20WVG: 0
2026-03-28 11:05:54 [bca.uk] INFO: Found listing with ID: HK25%20XAY
2026-03-28 11:05:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK25%2520XAY%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for HK25%20XAY: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: KK24%20AEF
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK24%2520AEF%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for KK24%20AEF: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: NA70%20XYD
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA70%2520XYD%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for NA70%20XYD: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: YN64%20XMG
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520XMG%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for YN64%20XMG: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: HPKD81239
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HPKD81239%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for HPKD81239: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: CV09%20TWA
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV09%2520TWA%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for CV09%20TWA: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: FY10%20BNJ
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for FY10%20BNJ: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: MF73%20FAO
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF73%2520FAO%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for MF73%20FAO: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: SP22%20OEE
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP22%2520OEE%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for SP22%20OEE: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: BW21%20DTN
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW21%2520DTN%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for BW21%20DTN: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: MD15%20XGB
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520XGB%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for MD15%20XGB: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: GV70%20RNA
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV70%2520RNA%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for GV70%20RNA: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: YS69%20EYY
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520EYY%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for YS69%20EYY: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: DA18%20EDK
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA18%2520EDK%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for DA18%20EDK: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: KR17%20WGP
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR17%2520WGP%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for KR17%20WGP: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: L10%20CLU
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L10%2520CLU%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for L10%20CLU: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: ML12%20ODX
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML12%2520ODX%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for ML12%20ODX: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: PN15%20EZH
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN15%2520EZH%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for PN15%20EZH: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: RX03%20AFU
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX03%2520AFU%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for RX03%20AFU: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: X188%20XCL
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X188%2520XCL%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for X188%20XCL: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: YM21%20TYH
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM21%2520TYH%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for YM21%20TYH: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: CP15%20POA
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP15%2520POA%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for CP15%20POA: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: YS69%20FCC
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520FCC%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for YS69%20FCC: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: DU22%20SVN
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU22%2520SVN%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for DU22%20SVN: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: GF18%20RFX
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520RFX%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for GF18%20RFX: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: LB68%20TVJ
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB68%2520TVJ%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for LB68%20TVJ: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: LG21%20HCM
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG21%2520HCM%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for LG21%20HCM: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: VK71%20GFX
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK71%2520GFX%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for VK71%20GFX: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: BD69%20XXF
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD69%2520XXF%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for BD69%20XXF: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: FG21%20MFN
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG21%2520MFN%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for FG21%20MFN: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: YG69%20LWF
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG69%2520LWF%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for YG69%20LWF: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: BD21%20GWA
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD21%2520GWA%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for BD21%20GWA: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: CP22%20GYW
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520GYW%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for CP22%20GYW: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: AD18%20GWP
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD18%2520GWP%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for AD18%20GWP: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: EU68%20NEJ
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU68%2520NEJ%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for EU68%20NEJ: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: DA72%20RSU
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520RSU%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for DA72%20RSU: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: GD18%20CFO
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520CFO%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for GD18%20CFO: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: MJ69%20AHZ
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520AHZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for MJ69%20AHZ: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: MJ69%20KSF
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ69%2520KSF%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for MJ69%20KSF: 0
2026-03-28 11:05:55 [bca.uk] INFO: Found listing with ID: PJ20%20EKU
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ20%2520EKU%27 HTTP/1.1" 200 None
2026-03-28 11:05:55 [bca.uk] INFO: Scrape type for PJ20%20EKU: 2
2026-03-28 11:05:55 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 23bea3aa-167f-56e1-a877-cec2b921be25 with identifier: PJ20%20EKU
2026-03-28 11:05:55 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 23bea3aa-167f-56e1-a877-cec2b921be25 with scrape type 2
2026-03-28 11:05:55 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 23bea3aa-167f-56e1-a877-cec2b921be25 with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 23bea3aa-167f-56e1-a877-cec2b921be25, identifier: PJ20%20EKU
2026-03-28 11:05:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:05:56 [bca.uk] INFO: Found listing with ID: BF65%20EKA
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520EKA%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [bca.uk] INFO: Scrape type for BF65%20EKA: 2
2026-03-28 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 59fdd222-b180-5d68-9c14-144daa326b17 with identifier: BF65%20EKA
2026-03-28 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 59fdd222-b180-5d68-9c14-144daa326b17 with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 59fdd222-b180-5d68-9c14-144daa326b17 with scrape type 2
2026-03-28 11:05:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 59fdd222-b180-5d68-9c14-144daa326b17, identifier: BF65%20EKA
2026-03-28 11:05:56 [bca.uk] INFO: Found listing with ID: SF69%20ZBX
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF69%2520ZBX%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [bca.uk] INFO: Scrape type for SF69%20ZBX: 1
2026-03-28 11:05:56 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX
2026-03-28 11:05:56 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302464%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302464 not downloaded yet
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240931%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240931 not downloaded yet
2026-03-28 11:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 23bea3aa-167f-56e1-a877-cec2b921be25 with identifier: PJ20%20EKU
2026-03-28 11:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 23bea3aa-167f-56e1-a877-cec2b921be25 with identifier: PJ20%20EKU
2026-03-28 11:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 23bea3aa-167f-56e1-a877-cec2b921be25 with identifier: PJ20%20EKU to the API
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=9&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 197,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ20%20EKU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '23bea3aa-167f-56e1-a877-cec2b921be25',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ20 EKU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ20%20EKU&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'KIA',
'model': 'SPORTAGE',
'odometer': 42227,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'KIA SPORTAGE 1.6 T GDI AWD GT-LINE ISG DCT StationWagon',
'transmission': 'automatic',
'trim': 'T GDI AWD GT-LINE ISG DCT',
'vin': 'U5YPK816WLL899522',
'year': 2020}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ20%2520EKU%27 HTTP/1.1" 200 None
2026-03-28 11:05:56 [bca.uk] INFO: Saving data for PJ20%20EKU: {'auction_closing_time': 1774864800.0, 'created_time': 1774304472.282177, 'last_price_update_time': 1774695956.597522}
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ20%2520EKU') HTTP/1.1" 204 0
2026-03-28 11:05:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 59fdd222-b180-5d68-9c14-144daa326b17 with identifier: BF65%20EKA
2026-03-28 11:05:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 59fdd222-b180-5d68-9c14-144daa326b17 with identifier: BF65%20EKA
2026-03-28 11:05:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 59fdd222-b180-5d68-9c14-144daa326b17 with identifier: BF65%20EKA to the API
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BF65%20EKA-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 6,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '59fdd222-b180-5d68-9c14-144daa326b17',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BF65 EKA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BF65%20EKA&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MINI',
'model': 'CLUBMAN',
'odometer': 81569,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MINI CLUBMAN 2.0 COOPER D Estate',
'transmission': 'automatic',
'trim': 'COOPER D',
'vin': 'WMWLR920702C06196',
'year': 2015}
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520EKA%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Saving data for BF65%20EKA: {'auction_closing_time': 1774864800.0, 'created_time': 1774564135.148997, 'last_price_update_time': 1774695957.073418}
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BF65%2520EKA') HTTP/1.1" 204 0
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296393%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296393 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147482%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147482 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822467%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822467 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818295%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818295 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794251%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794251 not downloaded yet
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: BP68%20KXF
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP68%2520KXF%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for BP68%20KXF: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: CE68%20OKN
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE68%2520OKN%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for CE68%20OKN: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: DA72%20OGE
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA72%2520OGE%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for DA72%20OGE: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: DU19%20VFP
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520VFP%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for DU19%20VFP: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: FX20%20RVN
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX20%2520RVN%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for FX20%20RVN: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: SW69%20HAX
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for SW69%20HAX: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: EK72%20OTR
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK72%2520OTR%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for EK72%20OTR: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: LB24%20EUL
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB24%2520EUL%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for LB24%20EUL: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: NV21%20KXR
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520KXR%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for NV21%20KXR: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: Y27%20JJL
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y27%2520JJL%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for Y27%20JJL: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: AU19%20UPB
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU19%2520UPB%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for AU19%20UPB: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: KW70%20FUH
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520FUH%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for KW70%20FUH: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: SX19%20UXH
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX19%2520UXH%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for SX19%20UXH: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: YS22%20UBT
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS22%2520UBT%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for YS22%20UBT: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: KJ19%20WBM
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520WBM%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for KJ19%20WBM: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: KV71%20AEO
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV71%2520AEO%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for KV71%20AEO: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: NV19%20UBR
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for NV19%20UBR: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: RV68%20LBX
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV68%2520LBX%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for RV68%20LBX: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: AO70%20ZYL
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO70%2520ZYL%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for AO70%20ZYL: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: AV72%20FBL
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV72%2520FBL%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for AV72%20FBL: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: AVI%205715
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AVI%25205715%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for AVI%205715: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: DS21%20XOB
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS21%2520XOB%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for DS21%20XOB: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: GF22%20CZO
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF22%2520CZO%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for GF22%20CZO: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: GJ23%20MRO
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ23%2520MRO%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for GJ23%20MRO: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: GV69%20PSU
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV69%2520PSU%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for GV69%20PSU: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: GX71%20XBS
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX71%2520XBS%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for GX71%20XBS: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: KJ19%20MZZ
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520MZZ%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for KJ19%20MZZ: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: AK69%20OPY
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK69%2520OPY%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for AK69%20OPY: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: BD19%20VEB
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD19%2520VEB%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for BD19%20VEB: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: CV18%20FNN
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520FNN%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for CV18%20FNN: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: NA69%20ZFR
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520ZFR%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for NA69%20ZFR: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: NM21%20OBX
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NM21%2520OBX%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for NM21%20OBX: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: SK70%20YOM
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520YOM%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for SK70%20YOM: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: BG19%20WNV
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG19%2520WNV%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for BG19%20WNV: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: WN19%20VBY
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN19%2520VBY%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for WN19%20VBY: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: DE15%20YKD
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE15%2520YKD%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for DE15%20YKD: 0
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: KO17%20XBK
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO17%2520XBK%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for KO17%20XBK: 1
2026-03-28 11:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK
2026-03-28 11:05:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: SD60%20OBV
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520OBV%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for SD60%20OBV: 1
2026-03-28 11:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV
2026-03-28 11:05:57 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302471%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302471 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240940%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240940 not downloaded yet
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814035/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818009/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818047/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818036/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296408%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296408 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147491%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147491 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822489%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822489 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818321%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818321 not downloaded yet
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794258%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794258 not downloaded yet
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818063/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:05:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:05:57 [bca.uk] INFO: Found listing with ID: LL14%20KEK
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL14%2520KEK%27 HTTP/1.1" 200 None
2026-03-28 11:05:57 [bca.uk] INFO: Scrape type for LL14%20KEK: 2
2026-03-28 11:05:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3da35472-1778-50c1-9748-b35cf0f94ddb with identifier: LL14%20KEK
2026-03-28 11:05:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3da35472-1778-50c1-9748-b35cf0f94ddb with scrape type 2
2026-03-28 11:05:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3da35472-1778-50c1-9748-b35cf0f94ddb with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3da35472-1778-50c1-9748-b35cf0f94ddb, identifier: LL14%20KEK
2026-03-28 11:05:58 [bca.uk] INFO: Found listing with ID: LR18%20TNX
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520TNX%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [bca.uk] INFO: Scrape type for LR18%20TNX: 1
2026-03-28 11:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX
2026-03-28 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302478%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302478 not downloaded yet
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240946%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240946 not downloaded yet
2026-03-28 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3da35472-1778-50c1-9748-b35cf0f94ddb with identifier: LL14%20KEK
2026-03-28 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3da35472-1778-50c1-9748-b35cf0f94ddb with identifier: LL14%20KEK
2026-03-28 11:05:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3da35472-1778-50c1-9748-b35cf0f94ddb with identifier: LL14%20KEK to the API
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL14%20KEK-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3da35472-1778-50c1-9748-b35cf0f94ddb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL14 KEK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL14%20KEK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 107891,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 2.0 TDCI 140 TITANIUM P/SHIFT MPV',
'transmission': 'automatic',
'trim': 'TDCI 140 TITANIUM P/SHIFT',
'vin': 'WF0HXXWPBHES02956',
'year': 2014}
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL14%2520KEK%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [bca.uk] INFO: Saving data for LL14%20KEK: {'auction_closing_time': 1774864800.0, 'created_time': 1773929434.224272, 'last_price_update_time': 1774695958.428555}
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL14%2520KEK') HTTP/1.1" 204 0
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296423%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296423 not downloaded yet
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147516%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147516 not downloaded yet
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822505%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822505 not downloaded yet
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818343%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818343 not downloaded yet
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794267%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794267 not downloaded yet
2026-03-28 11:05:58 [bca.uk] INFO: Found listing with ID: MD16%20BFY
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD16%2520BFY%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [bca.uk] INFO: Scrape type for MD16%20BFY: 2
2026-03-28 11:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY
2026-03-28 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with scrape type 2
2026-03-28 11:05:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6e5a312e-fa7b-5267-aa0f-037a5c97e933, identifier: MD16%20BFY
2026-03-28 11:05:58 [bca.uk] INFO: Found listing with ID: GY69%20LZL
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY69%2520LZL%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [bca.uk] INFO: Scrape type for GY69%20LZL: 1
2026-03-28 11:05:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL
2026-03-28 11:05:58 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302485%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302485 not downloaded yet
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240949%27 HTTP/1.1" 200 None
2026-03-28 11:05:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240949 not downloaded yet
2026-03-28 11:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147470>
2026-03-28 11:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794238/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794238>
2026-03-28 11:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818249/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818249>
2026-03-28 11:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814208/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814208>
2026-03-28 11:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296368>
2026-03-28 11:05:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822426/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822426>
2026-03-28 11:05:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818025/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:05:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY
2026-03-28 11:05:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY
2026-03-28 11:05:59 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6e5a312e-fa7b-5267-aa0f-037a5c97e933 with identifier: MD16%20BFY to the API
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:05:59 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MD16%20BFY-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6e5a312e-fa7b-5267-aa0f-037a5c97e933',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MD16 BFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MD16%20BFY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JEEP',
'model': 'RENEGADE',
'odometer': 87998,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'JEEP RENEGADE 1.4 M/AIR 140 LIMITED DDCT Hatchback',
'transmission': 'automatic',
'trim': 'M/AIR 140 LIMITED DDCT',
'vin': '1C4BU0000GPD76754',
'year': 2016}
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD16%2520BFY%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [bca.uk] INFO: Saving data for MD16%20BFY: {'auction_closing_time': 1774864800.0, 'created_time': 1773929441.735786, 'last_price_update_time': 1774695959.749164}
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MD16%2520BFY') HTTP/1.1" 204 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147533%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147533 not downloaded yet
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822526%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822526 not downloaded yet
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818377%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818377 not downloaded yet
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794280%27 HTTP/1.1" 200 None
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794280 not downloaded yet
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa7450>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814015%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814015/600 saved to cache
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e284b90>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814035%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814035/600 saved to cache
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e275050>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698818009%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818009/600 saved to cache
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2dac50>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818047%252F600') HTTP/1.1" 204 0
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818047/600 saved to cache
2026-03-28 11:05:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2405d0>
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:05:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:05:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698818036%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818036/600 saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e27dc90>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698818063%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818063/600 saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a6890>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818072%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818072/600 saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:00 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2d93d0>
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796796%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796796/600 saved to cache
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:06:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240940>
2026-03-28 11:06:00 [bca.uk] INFO: Found listing with ID: VHZ%203476
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25203476%27 HTTP/1.1" 200 None
2026-03-28 11:06:00 [bca.uk] INFO: Scrape type for VHZ%203476: 2
2026-03-28 11:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476
2026-03-28 11:06:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d317b4f9-66e8-54ad-81b8-adb7dc905d8d with scrape type 2
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d317b4f9-66e8-54ad-81b8-adb7dc905d8d with scrape type 2
2026-03-28 11:06:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d317b4f9-66e8-54ad-81b8-adb7dc905d8d, identifier: VHZ%203476
2026-03-28 11:06:00 [bca.uk] INFO: Found listing with ID: EY68%20NKD
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY68%2520NKD%27 HTTP/1.1" 200 None
2026-03-28 11:06:00 [bca.uk] INFO: Scrape type for EY68%20NKD: 1
2026-03-28 11:06:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD
2026-03-28 11:06:00 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302489%27 HTTP/1.1" 200 None
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302489 not downloaded yet
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D696240951%27 HTTP/1.1" 200 None
2026-03-28 11:06:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240951 not downloaded yet
2026-03-28 11:06:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476
2026-03-28 11:06:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476
2026-03-28 11:06:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d317b4f9-66e8-54ad-81b8-adb7dc905d8d with identifier: VHZ%203476 to the API
2026-03-28 11:06:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VHZ%203476-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd317b4f9-66e8-54ad-81b8-adb7dc905d8d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VHZ 3476',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VHZ%203476&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 62791,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 SE TECH StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 SE TECH',
'vin': 'SALCA2AN3HH698688',
'year': 2017}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VHZ%25203476%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [bca.uk] INFO: Saving data for VHZ%203476: {'auction_closing_time': 1774864800.0, 'created_time': 1774564112.360999, 'last_price_update_time': 1774695961.374947}
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VHZ%25203476') HTTP/1.1" 204 0
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147549%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147549 not downloaded yet
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822546%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822546 not downloaded yet
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818401%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818401 not downloaded yet
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794290%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794290 not downloaded yet
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822467/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822467>
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794251>
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302471>
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818295>
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD60%20OBV-GB>
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KO17%20XBK-GB>
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147482>
2026-03-28 11:06:01 [bca.uk] INFO: Found listing with ID: YL67%20NGU
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520NGU%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [bca.uk] INFO: Scrape type for YL67%20NGU: 1
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:01 [bca.uk] INFO: Found listing with ID: VA19%20XRY
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520XRY%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [bca.uk] INFO: Scrape type for VA19%20XRY: 1
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e30c350>
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818025%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818025/600 saved to cache
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822426/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147559%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147559 not downloaded yet
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822571%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822571 not downloaded yet
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818428%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818428 not downloaded yet
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794300%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794300 not downloaded yet
2026-03-28 11:06:01 [bca.uk] INFO: Found listing with ID: SV21%20ZGG
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZGG%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [bca.uk] INFO: Scrape type for SV21%20ZGG: 0
2026-03-28 11:06:01 [bca.uk] INFO: Found listing with ID: KE18%20FBA
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE18%2520FBA%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [bca.uk] INFO: Scrape type for KE18%20FBA: 2
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f988b089-a63b-5e33-b069-f3d4d7bd887a with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f988b089-a63b-5e33-b069-f3d4d7bd887a with scrape type 2
2026-03-28 11:06:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f988b089-a63b-5e33-b069-f3d4d7bd887a, identifier: KE18%20FBA
2026-03-28 11:06:01 [bca.uk] INFO: Found listing with ID: SD14%20UCC
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD14%2520UCC%27 HTTP/1.1" 200 None
2026-03-28 11:06:01 [bca.uk] INFO: Scrape type for SD14%20UCC: 1
2026-03-28 11:06:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC
2026-03-28 11:06:01 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:06:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794267/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794267>
2026-03-28 11:06:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA
2026-03-28 11:06:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA
2026-03-28 11:06:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f988b089-a63b-5e33-b069-f3d4d7bd887a with identifier: KE18%20FBA to the API
2026-03-28 11:06:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE18%20FBA-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f988b089-a63b-5e33-b069-f3d4d7bd887a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KE18 FBA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KE18%20FBA&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': 'X2',
'odometer': 48120,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW X2 2.0 XDRIVE 20D M SPORT STEP Hatchback',
'transmission': 'automatic',
'trim': 'XDRIVE 20D M SPORT STEP',
'vin': 'WBAYL12020EJ88775',
'year': 2018}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE18%2520FBA%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Saving data for KE18%20FBA: {'auction_closing_time': 1774778400.0, 'created_time': 1774592218.297219, 'last_price_update_time': 1774695962.124075}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KE18%2520FBA') HTTP/1.1" 204 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698147572%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147572 not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822593%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822593 not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818458%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818458 not downloaded yet
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794307%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794307 not downloaded yet
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818249/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794238/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814208/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: YP18%20HSO
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP18%2520HSO%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for YP18%20HSO: 1
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: PL68%20ZCX
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL68%2520ZCX%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for PL68%20ZCX: 1
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: FH18%20LKJ
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH18%2520LKJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for FH18%20LKJ: 1
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: PK14%20VAX
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK14%2520VAX%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for PK14%20VAX: 1
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac316750>
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822426%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822426/600 saved to cache
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe46950>
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296368%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296368/600 saved to cache
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822467/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794290>
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: HV54%20YKM
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV54%2520YKM%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for HV54%20YKM: 2
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f408b47c-d0ef-5c52-8291-68bc34708e07 with scrape type 2
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f408b47c-d0ef-5c52-8291-68bc34708e07 with scrape type 2
2026-03-28 11:06:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f408b47c-d0ef-5c52-8291-68bc34708e07, identifier: HV54%20YKM
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: PF65%20SSV
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520SSV%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for PF65%20SSV: 1
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0d734e44-52d9-57e4-8863-dc7d94854907 with identifier: PF65%20SSV
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM
2026-03-28 11:06:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM
2026-03-28 11:06:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f408b47c-d0ef-5c52-8291-68bc34708e07 with identifier: HV54%20YKM to the API
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HV54%20YKM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 2,
'engine': '0.7L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f408b47c-d0ef-5c52-8291-68bc34708e07',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HV54 YKM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HV54%20YKM&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 47543,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'SMART FORTWO 0.7 PURE Convertible',
'transmission': 'automatic',
'trim': 'PURE',
'vin': 'WME4504322J104030',
'year': 2004}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV54%2520YKM%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Saving data for HV54%20YKM: {'auction_closing_time': 1774778400.0, 'created_time': 1774592217.91663, 'last_price_update_time': 1774695962.841769}
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HV54%2520YKM') HTTP/1.1" 204 0
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794267/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: LF64%20ZKW
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF64%2520ZKW%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for LF64%20ZKW: 0
2026-03-28 11:06:02 [bca.uk] INFO: Found listing with ID: SH16%20FAF
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520FAF%27 HTTP/1.1" 200 None
2026-03-28 11:06:02 [bca.uk] INFO: Scrape type for SH16%20FAF: 2
2026-03-28 11:06:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF
2026-03-28 11:06:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 95b99faa-298b-5263-826d-f507a6c3ee71 with scrape type 2
2026-03-28 11:06:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 95b99faa-298b-5263-826d-f507a6c3ee71 with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 95b99faa-298b-5263-826d-f507a6c3ee71, identifier: SH16%20FAF
2026-03-28 11:06:03 [bca.uk] INFO: Found listing with ID: NG13%20GKJ
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG13%2520GKJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [bca.uk] INFO: Scrape type for NG13%20GKJ: 1
2026-03-28 11:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3 with identifier: NG13%20GKJ
2026-03-28 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794300>
2026-03-28 11:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD14%20UCC-GB>
2026-03-28 11:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818428/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818428>
2026-03-28 11:06:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF
2026-03-28 11:06:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF
2026-03-28 11:06:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 95b99faa-298b-5263-826d-f507a6c3ee71 with identifier: SH16%20FAF to the API
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SH16%20FAF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '95b99faa-298b-5263-826d-f507a6c3ee71',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SH16 FAF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SH16%20FAF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': 'X5',
'odometer': 110784,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'BMW X5 3.0 XDRIVE 30D M SPORT StationWagon',
'transmission': 'manual',
'trim': 'XDRIVE 30D M SPORT',
'vin': 'WBAKS420400J61018',
'year': 2016}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520FAF%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [bca.uk] INFO: Saving data for SH16%20FAF: {'auction_closing_time': 1774864800.0, 'created_time': 1773929457.418384, 'last_price_update_time': 1774695963.491461}
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SH16%2520FAF') HTTP/1.1" 204 0
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac537710>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818249%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818249/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe4490>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794238%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794238/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2d8a90>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147470%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147470/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe4990>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147482%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147482/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a6890>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814208%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814208/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:03 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff965d0>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240940%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240940/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2dbdd0>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818295%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818295/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3745d0>
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822467%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822467/600 saved to cache
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822571/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822571>
2026-03-28 11:06:03 [bca.uk] INFO: Found listing with ID: SP17%20UUO
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP17%2520UUO%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [bca.uk] INFO: Scrape type for SP17%20UUO: 0
2026-03-28 11:06:03 [bca.uk] INFO: Found listing with ID: YC17%20HBJ
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520HBJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [bca.uk] INFO: Scrape type for YC17%20HBJ: 0
2026-03-28 11:06:03 [bca.uk] INFO: Found listing with ID: EY66%20AWF
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY66%2520AWF%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [bca.uk] INFO: Scrape type for EY66%20AWF: 0
2026-03-28 11:06:03 [bca.uk] INFO: Found listing with ID: AV56%20FEX
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520FEX%27 HTTP/1.1" 200 None
2026-03-28 11:06:03 [bca.uk] INFO: Scrape type for AV56%20FEX: 2
2026-03-28 11:06:03 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX
2026-03-28 11:06:03 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 640cef89-a124-5065-b499-d8910fb0a63d with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 640cef89-a124-5065-b499-d8910fb0a63d with scrape type 2
2026-03-28 11:06:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 640cef89-a124-5065-b499-d8910fb0a63d, identifier: AV56%20FEX
2026-03-28 11:06:03 [bca.uk] INFO: Found listing with ID: MF64%20ZPZ
2026-03-28 11:06:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF64%2520ZPZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [bca.uk] INFO: Scrape type for MF64%20ZPZ: 1
2026-03-28 11:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65008501-d7e3-5111-b4f9-a8e8adb781bc with identifier: MF64%20ZPZ
2026-03-28 11:06:04 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX
2026-03-28 11:06:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX
2026-03-28 11:06:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 640cef89-a124-5065-b499-d8910fb0a63d with identifier: AV56%20FEX to the API
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 271,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV56%20FEX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.7L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '640cef89-a124-5065-b499-d8910fb0a63d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV56 FEX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV56%20FEX&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 92528,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 2.7 TDV6 HSE StationWagon',
'transmission': 'automatic',
'trim': 'TDV6 HSE',
'vin': 'SALLSAA136A970472',
'year': 2006}
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV56%2520FEX%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [bca.uk] INFO: Saving data for AV56%20FEX: {'auction_closing_time': 1774864800.0, 'created_time': 1774048159.684442, 'last_price_update_time': 1774695964.780877}
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV56%2520FEX') HTTP/1.1" 204 0
2026-03-28 11:06:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad318290>
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302471%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302471/600 saved to cache
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feff6d0>
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794251%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794251/600 saved to cache
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff95a90>
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794267%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794267/600 saved to cache
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA19%20XRY-GB>
2026-03-28 11:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL68%20ZCX-GB>
2026-03-28 11:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK14%20VAX-GB>
2026-03-28 11:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147559/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147559>
2026-03-28 11:06:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH18%20LKJ-GB>
2026-03-28 11:06:04 [bca.uk] INFO: Found listing with ID: EK63%20ZDN
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520ZDN%27 HTTP/1.1" 200 None
2026-03-28 11:06:04 [bca.uk] INFO: Scrape type for EK63%20ZDN: 2
2026-03-28 11:06:04 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with identifier: EK63%20ZDN
2026-03-28 11:06:04 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with scrape type 2
2026-03-28 11:06:04 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4, identifier: EK63%20ZDN
2026-03-28 11:06:05 [bca.uk] INFO: Found listing with ID: HW69%20EOS
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW69%2520EOS%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [bca.uk] INFO: Scrape type for HW69%20EOS: 2
2026-03-28 11:06:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31c4cf7a-4b9a-51c2-8fec-e570752325ef with identifier: HW69%20EOS
2026-03-28 11:06:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31c4cf7a-4b9a-51c2-8fec-e570752325ef with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31c4cf7a-4b9a-51c2-8fec-e570752325ef with scrape type 2
2026-03-28 11:06:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31c4cf7a-4b9a-51c2-8fec-e570752325ef, identifier: HW69%20EOS
2026-03-28 11:06:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with identifier: EK63%20ZDN
2026-03-28 11:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with identifier: EK63%20ZDN
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0850c36-b8be-56f6-9fc7-bd707dcfb4b4 with identifier: EK63%20ZDN to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK63%20ZDN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 2,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e0850c36-b8be-56f6-9fc7-bd707dcfb4b4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK63 ZDN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK63%20ZDN&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'SMART',
'model': 'FORTWO',
'odometer': 90808,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SMART FORTWO 1.0 MHD PASSION S/TOUCH Coupe',
'transmission': 'automatic',
'trim': 'MHD PASSION S/TOUCH',
'vin': 'WME4513802K742213',
'year': 2013}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK63%2520ZDN%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [bca.uk] INFO: Saving data for EK63%20ZDN: {'auction_closing_time': 1774864800.0, 'created_time': 1774564120.580905, 'last_price_update_time': 1774695965.573352}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK63%2520ZDN') HTTP/1.1" 204 0
2026-03-28 11:06:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31c4cf7a-4b9a-51c2-8fec-e570752325ef with identifier: HW69%20EOS
2026-03-28 11:06:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31c4cf7a-4b9a-51c2-8fec-e570752325ef with identifier: HW69%20EOS
2026-03-28 11:06:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31c4cf7a-4b9a-51c2-8fec-e570752325ef with identifier: HW69%20EOS to the API
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HW69%20EOS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '31c4cf7a-4b9a-51c2-8fec-e570752325ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HW69 EOS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HW69%20EOS&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 43323,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 AMG LINE EXECUTIVE DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE EXECUTIVE DCT',
'vin': 'WDD1770032J129716',
'year': 2019}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW69%2520EOS%27 HTTP/1.1" 200 None
2026-03-28 11:06:05 [bca.uk] INFO: Saving data for HW69%20EOS: {'auction_closing_time': 1774951200.0, 'created_time': 1774437522.567848, 'last_price_update_time': 1774695965.976557}
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HW69%2520EOS') HTTP/1.1" 204 0
2026-03-28 11:06:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP18%20HSO-GB>
2026-03-28 11:06:06 [bca.uk] INFO: Found listing with ID: GY61%20XPC
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY61%2520XPC%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [bca.uk] INFO: Scrape type for GY61%20XPC: 2
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e0c1b047-c8a3-520a-8290-8a514d31de91 with identifier: GY61%20XPC
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e0c1b047-c8a3-520a-8290-8a514d31de91 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e0c1b047-c8a3-520a-8290-8a514d31de91 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e0c1b047-c8a3-520a-8290-8a514d31de91, identifier: GY61%20XPC
2026-03-28 11:06:06 [bca.uk] INFO: Found listing with ID: FP70%20XEN
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP70%2520XEN%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [bca.uk] INFO: Scrape type for FP70%20XEN: 1
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 09367c6e-3396-5657-95ea-a9c92174c186 with identifier: FP70%20XEN
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec1090>
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_expert_report_file_eb0674a4-af22-4e00-b9cf-86c1822c2e2a.pdf HTTP/1.1" 201 0
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce90445-cafa-5c75-bbfc-7c7467058c9b, skipping ID generation
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKO17XBK-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KO17XBK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea67610>
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_expert_report_file_bcb297de-f80e-4ca6-b455-18838a675dd1.pdf HTTP/1.1" 201 0
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fca0f45a-4408-54bd-8e77-e17744d1d730, skipping ID generation
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSD60OBV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD60OBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818458/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818458>
2026-03-28 11:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794307/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794307>
2026-03-28 11:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF65%20SSV-GB>
2026-03-28 11:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818428/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e0c1b047-c8a3-520a-8290-8a514d31de91 with identifier: GY61%20XPC
2026-03-28 11:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e0c1b047-c8a3-520a-8290-8a514d31de91 with identifier: GY61%20XPC
2026-03-28 11:06:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e0c1b047-c8a3-520a-8290-8a514d31de91 with identifier: GY61%20XPC to the API
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 140,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY61%20XPC-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e0c1b047-c8a3-520a-8290-8a514d31de91',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY61 XPC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY61%20XPC&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'BMW',
'model': '320D',
'odometer': 108059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 EXCLUSIVE EDITION STEP Saloon',
'transmission': 'manual',
'trim': 'EXCLUSIVE EDITION STEP',
'vin': 'WBAPP12090F029956',
'year': 2011}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY61%2520XPC%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [bca.uk] INFO: Saving data for GY61%20XPC: {'auction_closing_time': 1774864800.0, 'created_time': 1774015395.602828, 'last_price_update_time': 1774695966.674963}
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY61%2520XPC') HTTP/1.1" 204 0
2026-03-28 11:06:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:06 [bca.uk] INFO: Found listing with ID: LC16%20BCV
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520BCV%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [bca.uk] INFO: Scrape type for LC16%20BCV: 2
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 587ed70c-235c-5f06-b284-969b01a1cbb2 with identifier: LC16%20BCV
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 587ed70c-235c-5f06-b284-969b01a1cbb2 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 587ed70c-235c-5f06-b284-969b01a1cbb2 with scrape type 2
2026-03-28 11:06:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 587ed70c-235c-5f06-b284-969b01a1cbb2, identifier: LC16%20BCV
2026-03-28 11:06:06 [bca.uk] INFO: Found listing with ID: FJ16%20YOR
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520YOR%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [bca.uk] INFO: Scrape type for FJ16%20YOR: 1
2026-03-28 11:06:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6f0a65b2-f444-59d5-a5b9-263002d87b3b with identifier: FJ16%20YOR
2026-03-28 11:06:06 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088388%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088388 not downloaded yet
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813390%27 HTTP/1.1" 200 None
2026-03-28 11:06:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813390 not downloaded yet
2026-03-28 11:06:06 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG13%20GKJ-GB>
2026-03-28 11:06:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 587ed70c-235c-5f06-b284-969b01a1cbb2 with identifier: LC16%20BCV
2026-03-28 11:06:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 587ed70c-235c-5f06-b284-969b01a1cbb2 with identifier: LC16%20BCV
2026-03-28 11:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 587ed70c-235c-5f06-b284-969b01a1cbb2 with identifier: LC16%20BCV to the API
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC16%20BCV-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Electric',
'id': '587ed70c-235c-5f06-b284-969b01a1cbb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC16 BCV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC16%20BCV&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'KIA',
'model': 'SOUL',
'odometer': 64222,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'KIA SOUL EV Hatchback',
'transmission': 'automatic',
'trim': 'EV',
'vin': 'KNAJX81EUG7014973',
'year': 2016}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520BCV%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [bca.uk] INFO: Saving data for LC16%20BCV: {'auction_closing_time': 1774864800.0, 'created_time': 1774564096.795153, 'last_price_update_time': 1774695967.358878}
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC16%2520BCV') HTTP/1.1" 204 0
2026-03-28 11:06:07 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:07 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:07 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:07 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac158190>
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:07 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794290%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794290/600 saved to cache
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822571/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:07 [bca.uk] INFO: Found listing with ID: LO13%20NYW
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520NYW%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [bca.uk] INFO: Scrape type for LO13%20NYW: 2
2026-03-28 11:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7a1a26e5-34c8-56da-a185-571e5533f217 with identifier: LO13%20NYW
2026-03-28 11:06:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7a1a26e5-34c8-56da-a185-571e5533f217 with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7a1a26e5-34c8-56da-a185-571e5533f217 with scrape type 2
2026-03-28 11:06:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7a1a26e5-34c8-56da-a185-571e5533f217, identifier: LO13%20NYW
2026-03-28 11:06:07 [bca.uk] INFO: Found listing with ID: FD20%20CUW
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD20%2520CUW%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [bca.uk] INFO: Scrape type for FD20%20CUW: 1
2026-03-28 11:06:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9108cc1a-a955-5b82-8aab-ca366edb3cb0 with identifier: FD20%20CUW
2026-03-28 11:06:07 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088392%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088392 not downloaded yet
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813401%27 HTTP/1.1" 200 None
2026-03-28 11:06:07 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813401 not downloaded yet
2026-03-28 11:06:07 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147559/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7a1a26e5-34c8-56da-a185-571e5533f217 with identifier: LO13%20NYW
2026-03-28 11:06:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7a1a26e5-34c8-56da-a185-571e5533f217 with identifier: LO13%20NYW
2026-03-28 11:06:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7a1a26e5-34c8-56da-a185-571e5533f217 with identifier: LO13%20NYW to the API
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 96,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO13%20NYW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.8L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '7a1a26e5-34c8-56da-a185-571e5533f217',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LO13 NYW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO13%20NYW&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'TOYOTA',
'model': 'PRIUS+',
'odometer': 102174,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'TOYOTA PRIUS+ 1.8 VVTI T4 HYBRID MPV',
'transmission': 'automatic',
'trim': 'VVTI T4 HYBRID',
'vin': 'JTDZS3EU403047559',
'year': 2013}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO13%2520NYW%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [bca.uk] INFO: Saving data for LO13%20NYW: {'auction_closing_time': 1774864800.0, 'created_time': 1774564078.703365, 'last_price_update_time': 1774695968.037075}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO13%2520NYW') HTTP/1.1" 204 0
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2c2690>
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818428%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818428/600 saved to cache
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff882d0>
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794300%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794300/600 saved to cache
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:08 [bca.uk] INFO: Found listing with ID: ND21%20TWM
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND21%2520TWM%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [bca.uk] INFO: Scrape type for ND21%20TWM: 2
2026-03-28 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ea206cea-4dcc-5d6b-9fa8-96d75aac89ce with identifier: ND21%20TWM
2026-03-28 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ea206cea-4dcc-5d6b-9fa8-96d75aac89ce with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ea206cea-4dcc-5d6b-9fa8-96d75aac89ce with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ea206cea-4dcc-5d6b-9fa8-96d75aac89ce, identifier: ND21%20TWM
2026-03-28 11:06:08 [bca.uk] INFO: Found listing with ID: DN60%20UCJ
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UCJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [bca.uk] INFO: Scrape type for DN60%20UCJ: 1
2026-03-28 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d6b222de-eba3-50da-a820-7f016bb30365 with identifier: DN60%20UCJ
2026-03-28 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088396%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088396 not downloaded yet
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813410%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813410 not downloaded yet
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ea206cea-4dcc-5d6b-9fa8-96d75aac89ce with identifier: ND21%20TWM
2026-03-28 11:06:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ea206cea-4dcc-5d6b-9fa8-96d75aac89ce with identifier: ND21%20TWM
2026-03-28 11:06:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ea206cea-4dcc-5d6b-9fa8-96d75aac89ce with identifier: ND21%20TWM to the API
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ND21%20TWM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ea206cea-4dcc-5d6b-9fa8-96d75aac89ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ND21 TWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ND21%20TWM&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 100139,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.5 E-TSI 150 LIFE DSG Hatchback',
'transmission': 'automatic',
'trim': 'E-TSI 150 LIFE DSG',
'vin': 'WVWZZZCDZMW320213',
'year': 2021}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND21%2520TWM%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [bca.uk] INFO: Saving data for ND21%20TWM: {'auction_closing_time': 1774864800.0, 'created_time': 1774564099.547737, 'last_price_update_time': 1774695968.69609}
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ND21%2520TWM') HTTP/1.1" 204 0
2026-03-28 11:06:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF64%20ZPZ-GB>
2026-03-28 11:06:08 [bca.uk] INFO: Found listing with ID: OV62%20USF
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV62%2520USF%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [bca.uk] INFO: Scrape type for OV62%20USF: 2
2026-03-28 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66ba1289-2c59-5945-9310-dc01cc697b48 with identifier: OV62%20USF
2026-03-28 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66ba1289-2c59-5945-9310-dc01cc697b48 with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66ba1289-2c59-5945-9310-dc01cc697b48 with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 66ba1289-2c59-5945-9310-dc01cc697b48, identifier: OV62%20USF
2026-03-28 11:06:08 [bca.uk] INFO: Found listing with ID: BX19%20MWY
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX19%2520MWY%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [bca.uk] INFO: Scrape type for BX19%20MWY: 2
2026-03-28 11:06:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e371fb26-e928-5226-84b1-b9f0604d2e81 with identifier: BX19%20MWY
2026-03-28 11:06:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e371fb26-e928-5226-84b1-b9f0604d2e81 with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e371fb26-e928-5226-84b1-b9f0604d2e81 with scrape type 2
2026-03-28 11:06:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e371fb26-e928-5226-84b1-b9f0604d2e81, identifier: BX19%20MWY
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088400%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088400 not downloaded yet
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813424%27 HTTP/1.1" 200 None
2026-03-28 11:06:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813424 not downloaded yet
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb2f950>
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822571%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822571/600 saved to cache
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea98250>
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147559%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147559/600 saved to cache
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 66ba1289-2c59-5945-9310-dc01cc697b48 with identifier: OV62%20USF
2026-03-28 11:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 66ba1289-2c59-5945-9310-dc01cc697b48 with identifier: OV62%20USF
2026-03-28 11:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 66ba1289-2c59-5945-9310-dc01cc697b48 with identifier: OV62%20USF to the API
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OV62%20USF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '66ba1289-2c59-5945-9310-dc01cc697b48',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OV62 USF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OV62%20USF&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VAUXHALL',
'model': 'ASTRA GTC',
'odometer': 82236,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA GTC 1.4 T 16V 140 SRI Coupe',
'transmission': 'automatic',
'trim': 'T 16V 140 SRI',
'vin': 'W0LPF2EC4DG027533',
'year': 2012}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV62%2520USF%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [bca.uk] INFO: Saving data for OV62%20USF: {'auction_closing_time': 1774864800.0, 'created_time': 1774564079.443957, 'last_price_update_time': 1774695969.440297}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OV62%2520USF') HTTP/1.1" 204 0
2026-03-28 11:06:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e371fb26-e928-5226-84b1-b9f0604d2e81 with identifier: BX19%20MWY
2026-03-28 11:06:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e371fb26-e928-5226-84b1-b9f0604d2e81 with identifier: BX19%20MWY
2026-03-28 11:06:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e371fb26-e928-5226-84b1-b9f0604d2e81 with identifier: BX19%20MWY to the API
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BX19%20MWY-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'e371fb26-e928-5226-84b1-b9f0604d2e81',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BX19 MWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BX19%20MWY&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'MERCEDES-BENZ',
'model': 'A180 D',
'odometer': 35630,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A180 D 1.5 SPORT DCT Hatchback',
'transmission': 'automatic',
'trim': 'SPORT DCT',
'vin': 'WDD1770032N052905',
'year': 2019}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX19%2520MWY%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [bca.uk] INFO: Saving data for BX19%20MWY: {'auction_closing_time': 1774951200.0, 'created_time': 1774437578.376375, 'last_price_update_time': 1774695969.786569}
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BX19%2520MWY') HTTP/1.1" 204 0
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794307/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818458/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:09 [bca.uk] INFO: Found listing with ID: YR18%20HBP
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520HBP%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [bca.uk] INFO: Scrape type for YR18%20HBP: 2
2026-03-28 11:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 153d2e39-fb82-56e9-af98-7912ef4a6c0d with identifier: YR18%20HBP
2026-03-28 11:06:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 153d2e39-fb82-56e9-af98-7912ef4a6c0d with scrape type 2
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 153d2e39-fb82-56e9-af98-7912ef4a6c0d with scrape type 2
2026-03-28 11:06:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 153d2e39-fb82-56e9-af98-7912ef4a6c0d, identifier: YR18%20HBP
2026-03-28 11:06:09 [bca.uk] INFO: Found listing with ID: BK64%20WXM
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520WXM%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [bca.uk] INFO: Scrape type for BK64%20WXM: 1
2026-03-28 11:06:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 968e893f-f12d-5bf3-9181-e47269b48833 with identifier: BK64%20WXM
2026-03-28 11:06:09 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088405%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088405 not downloaded yet
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813439%27 HTTP/1.1" 200 None
2026-03-28 11:06:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813439 not downloaded yet
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e821cd0>
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_expert_report_file_cd33ebac-6791-4e90-86a6-49d40d1187c2.pdf HTTP/1.1" 201 0
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2, skipping ID generation
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSD14UCC-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD14UCC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc53d10>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_expert_report_file_462a1f11-6fd1-4f6d-8b8a-deec6ca7d8a7.pdf HTTP/1.1" 201 0
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb25d155-3621-58d2-8d7a-91adc9b51d32, skipping ID generation
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPK14VAX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK14VAX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e895290>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_expert_report_file_dc6b3bed-36b9-4c8c-bad0-58cf8fe78852.pdf HTTP/1.1" 201 0
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01d1abad-b65f-5ff3-9afb-406711acef32, skipping ID generation
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFH18LKJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FH18LKJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffdd3d0>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_expert_report_file_2cac820e-8849-4404-be6f-d70e390508f4.pdf HTTP/1.1" 201 0
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c5f13b8-4d4a-53db-9b96-4c70590a110e, skipping ID generation
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPL68ZCX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PL68ZCX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eac9b50>
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_expert_report_file_381d29fa-930f-4855-894a-e6a62f8844a0.pdf HTTP/1.1" 201 0
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f11c4c-dabf-588c-a1de-3167e7ec7290, skipping ID generation
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYP18HSO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP18HSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822593/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822593>
2026-03-28 11:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088388>
2026-03-28 11:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813390>
2026-03-28 11:06:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD60OBV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 153d2e39-fb82-56e9-af98-7912ef4a6c0d with identifier: YR18%20HBP
2026-03-28 11:06:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 153d2e39-fb82-56e9-af98-7912ef4a6c0d with identifier: YR18%20HBP
2026-03-28 11:06:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 153d2e39-fb82-56e9-af98-7912ef4a6c0d with identifier: YR18%20HBP to the API
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 173,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR18%20HBP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '153d2e39-fb82-56e9-af98-7912ef4a6c0d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR18 HBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR18%20HBP&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'FORD',
'model': 'KUGA',
'odometer': 69931,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 1.5 E/B 182 4WD TITANIUM StationWagon',
'transmission': 'automatic',
'trim': 'E/B 182 4WD TITANIUM',
'vin': 'WF0AXXWPMAJL42933',
'year': 2018}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR18%2520HBP%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Saving data for YR18%20HBP: {'auction_closing_time': 1774864800.0, 'created_time': 1774564102.304493, 'last_price_update_time': 1774695970.516326}
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR18%2520HBP') HTTP/1.1" 204 0
2026-03-28 11:06:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: LG65%20ZPF
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG65%2520ZPF%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for LG65%20ZPF: 2
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af864b60-63a5-5238-8b52-757cd22bd15a with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af864b60-63a5-5238-8b52-757cd22bd15a with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af864b60-63a5-5238-8b52-757cd22bd15a, identifier: LG65%20ZPF
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: YM19%20ZGY
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM19%2520ZGY%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for YM19%20ZGY: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: SV64%20UUP
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV64%2520UUP%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for SV64%20UUP: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: RX11%20HTV
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX11%2520HTV%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for RX11%20HTV: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: RA65%20EUT
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA65%2520EUT%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for RA65%20EUT: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: OV66%20ZBZ
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV66%2520ZBZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for OV66%20ZBZ: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: NK16%20EGE
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK16%2520EGE%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for NK16%20EGE: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: MT10%20XMZ
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT10%2520XMZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for MT10%20XMZ: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: LY16%20JJK
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY16%2520JJK%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for LY16%20JJK: 0
2026-03-28 11:06:10 [bca.uk] INFO: Found listing with ID: LN09%20XAL
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN09%2520XAL%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [bca.uk] INFO: Scrape type for LN09%20XAL: 2
2026-03-28 11:06:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d3db8936-13ae-5f6b-8fdb-b0629fe51d5f with identifier: LN09%20XAL
2026-03-28 11:06:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d3db8936-13ae-5f6b-8fdb-b0629fe51d5f with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d3db8936-13ae-5f6b-8fdb-b0629fe51d5f with scrape type 2
2026-03-28 11:06:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d3db8936-13ae-5f6b-8fdb-b0629fe51d5f, identifier: LN09%20XAL
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088413%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088413 not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813482%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813482 not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797313%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797313 not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802289%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802289 not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827978%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827978 not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775753%27 HTTP/1.1" 200 None
2026-03-28 11:06:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775753 not downloaded yet
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822371%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822371 not downloaded yet
2026-03-28 11:06:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813401>
2026-03-28 11:06:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088392>
2026-03-28 11:06:11 [scrapy.extensions.logstats] INFO: Crawled 151 pages (at 28 pages/min), scraped 324 items (at 55 items/min)
2026-03-28 11:06:11 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF
2026-03-28 11:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF
2026-03-28 11:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af864b60-63a5-5238-8b52-757cd22bd15a with identifier: LG65%20ZPF to the API
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LG65%20ZPF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af864b60-63a5-5238-8b52-757cd22bd15a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LG65 ZPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LG65%20ZPF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 37595,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 70 STING Hatchback',
'transmission': 'manual',
'trim': '70 STING',
'vin': 'W0L0XEP08F4285128',
'year': 2015}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG65%2520ZPF%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [bca.uk] INFO: Saving data for LG65%20ZPF: {'auction_closing_time': 1774778400.0, 'created_time': 1774354752.45167, 'last_price_update_time': 1774695971.488764}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LG65%2520ZPF') HTTP/1.1" 204 0
2026-03-28 11:06:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d3db8936-13ae-5f6b-8fdb-b0629fe51d5f with identifier: LN09%20XAL
2026-03-28 11:06:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d3db8936-13ae-5f6b-8fdb-b0629fe51d5f with identifier: LN09%20XAL
2026-03-28 11:06:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d3db8936-13ae-5f6b-8fdb-b0629fe51d5f with identifier: LN09%20XAL to the API
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LN09%20XAL-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd3db8936-13ae-5f6b-8fdb-b0629fe51d5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LN09 XAL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LN09%20XAL&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 87971,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.4 ACENTA 16V Hatchback',
'transmission': 'automatic',
'trim': 'ACENTA 16V',
'vin': 'SJNFCAK12U3112823',
'year': 2009}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN09%2520XAL%27 HTTP/1.1" 200 None
2026-03-28 11:06:11 [bca.uk] INFO: Saving data for LN09%20XAL: {'auction_closing_time': 1775037600.0, 'created_time': 1774598505.998069, 'last_price_update_time': 1774695971.949024}
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LN09%2520XAL') HTTP/1.1" 204 0
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e582bd0>
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_expert_report_file_a879bfe9-1f73-4a87-aef5-7a6099c5e587.pdf HTTP/1.1" 201 0
2026-03-28 11:06:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15, skipping ID generation
2026-03-28 11:06:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DVA19XRY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VA19XRY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5b6bd0>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794307%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794307/600 saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9c2c10>
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818458%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818458/600 saved to cache
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813410>
2026-03-28 11:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN60%20UCJ-GB>
2026-03-28 11:06:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088396/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088396>
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: JE51%20XXE
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JE51%2520XXE%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for JE51%20XXE: 2
2026-03-28 11:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 74147a19-73e1-5358-899d-837db1dcdbdb with identifier: JE51%20XXE
2026-03-28 11:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 74147a19-73e1-5358-899d-837db1dcdbdb with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 74147a19-73e1-5358-899d-837db1dcdbdb with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 74147a19-73e1-5358-899d-837db1dcdbdb, identifier: JE51%20XXE
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: LM12%20MLU
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520MLU%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for LM12%20MLU: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: HY16%20EOC
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY16%2520EOC%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for HY16%20EOC: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: HN08%20FLX
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN08%2520FLX%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for HN08%20FLX: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: EU15%20WHR
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU15%2520WHR%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for EU15%20WHR: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: EA66%20LNX
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA66%2520LNX%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for EA66%20LNX: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: EA10%20ODR
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA10%2520ODR%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for EA10%20ODR: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: CX71%20YVZ
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX71%2520YVZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for CX71%20YVZ: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: CV62%20SNJ
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV62%2520SNJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for CV62%20SNJ: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: CE53%20GKN
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE53%2520GKN%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for CE53%20GKN: 0
2026-03-28 11:06:12 [bca.uk] INFO: Found listing with ID: BK16%20VKS
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520VKS%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Scrape type for BK16%20VKS: 2
2026-03-28 11:06:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 11017493-601f-5259-812d-95e0984bcd4f with identifier: BK16%20VKS
2026-03-28 11:06:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 11017493-601f-5259-812d-95e0984bcd4f with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 11017493-601f-5259-812d-95e0984bcd4f with scrape type 2
2026-03-28 11:06:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 11017493-601f-5259-812d-95e0984bcd4f, identifier: BK16%20VKS
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088419%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088419 not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813520%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813520 not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797326%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797326 not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802310%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802310 not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827989%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827989 not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775764%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775764 not downloaded yet
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822389%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822389 not downloaded yet
2026-03-28 11:06:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 74147a19-73e1-5358-899d-837db1dcdbdb with identifier: JE51%20XXE
2026-03-28 11:06:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 74147a19-73e1-5358-899d-837db1dcdbdb with identifier: JE51%20XXE
2026-03-28 11:06:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 74147a19-73e1-5358-899d-837db1dcdbdb with identifier: JE51%20XXE to the API
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 163,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=JE51%20XXE-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '74147a19-73e1-5358-899d-837db1dcdbdb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'JE51 XXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=JE51%20XXE&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'AUDI',
'model': 'Q7',
'odometer': 102983,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'AUDI Q7 3.0 TDI 272 QUATTRO S LINE TIP StationWagon',
'transmission': 'manual',
'trim': 'TDI 272 QUATTRO S LINE TIP',
'vin': 'WAUZZZ4M8GD062258',
'year': 2016}
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JE51%2520XXE%27 HTTP/1.1" 200 None
2026-03-28 11:06:12 [bca.uk] INFO: Saving data for JE51%20XXE: {'auction_closing_time': 1774864800.0, 'created_time': 1773907481.761435, 'last_price_update_time': 1774695972.983844}
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='JE51%2520XXE') HTTP/1.1" 204 0
2026-03-28 11:06:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 11017493-601f-5259-812d-95e0984bcd4f with identifier: BK16%20VKS
2026-03-28 11:06:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 11017493-601f-5259-812d-95e0984bcd4f with identifier: BK16%20VKS
2026-03-28 11:06:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 11017493-601f-5259-812d-95e0984bcd4f with identifier: BK16%20VKS to the API
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=8&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 183,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK16%20VKS-GB',
'category': 'LightCommercialVehicle',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.3L',
'expiration_date': '2026-04-10T10:00:00Z',
'fuel_type': 'Diesel',
'id': '11017493-601f-5259-812d-95e0984bcd4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK16 VKS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK16%20VKS&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'NISSAN',
'model': 'NP300 NAVARA',
'odometer': 111579,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'NISSAN NP300 NAVARA 2.3 DCI 190 4WD TEKNA CrewCab Pick-up',
'transmission': 'automatic',
'trim': 'DCI 190 4WD TEKNA',
'vin': 'VSKCTND23U0006360',
'year': 2016}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520VKS%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Saving data for BK16%20VKS: {'auction_closing_time': 1775815200.0, 'created_time': 1774598505.045586, 'last_price_update_time': 1774695973.406983}
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK16%2520VKS') HTTP/1.1" 204 0
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797314%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797314 not downloaded yet
2026-03-28 11:06:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088400>
2026-03-28 11:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813424>
2026-03-28 11:06:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD20%20CUW-GB>
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: YP67%20WCD
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP67%2520WCD%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for YP67%20WCD: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: MM14%20NXE
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM14%2520NXE%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for MM14%20NXE: 2
2026-03-28 11:06:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE
2026-03-28 11:06:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8812022e-2c81-54c5-9257-d256cd76a478 with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8812022e-2c81-54c5-9257-d256cd76a478 with scrape type 2
2026-03-28 11:06:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8812022e-2c81-54c5-9257-d256cd76a478, identifier: MM14%20NXE
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: AJ62%20YSE
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ62%2520YSE%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for AJ62%20YSE: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: AY57%20YXB
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY57%2520YXB%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for AY57%20YXB: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: AF69%20UFS
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF69%2520UFS%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for AF69%20UFS: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: WN09%20MYP
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN09%2520MYP%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for WN09%20MYP: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: PY61%20EWD
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY61%2520EWD%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for PY61%20EWD: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: MT61%20WPK
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT61%2520WPK%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for MT61%20WPK: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: EF66%20LFH
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF66%2520LFH%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for EF66%20LFH: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: AV18%20UVO
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520UVO%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for AV18%20UVO: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: AP13%20PNX
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP13%2520PNX%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for AP13%20PNX: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: GL20%20NXU
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL20%2520NXU%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for GL20%20NXU: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: OY12%20USJ
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY12%2520USJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for OY12%20USJ: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: LX12%20WRZ
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX12%2520WRZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for LX12%20WRZ: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: DA15%20GVJ
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA15%2520GVJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for DA15%20GVJ: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: MA18%20EAW
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA18%2520EAW%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for MA18%20EAW: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: WJ07%20XMW
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ07%2520XMW%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for WJ07%20XMW: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: TGZ%201807
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TGZ%25201807%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for TGZ%201807: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: YJ66%20AAP
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ66%2520AAP%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for YJ66%20AAP: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: BN10%20OKD
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN10%2520OKD%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for BN10%20OKD: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: HY73%20KHK
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY73%2520KHK%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for HY73%20KHK: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: WG22%20GHY
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG22%2520GHY%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for WG22%20GHY: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: EN71%20UET
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN71%2520UET%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for EN71%20UET: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: GL71%20USX
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL71%2520USX%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for GL71%20USX: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: LF72%20EGY
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF72%2520EGY%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for LF72%20EGY: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: LG23%20XZX
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG23%2520XZX%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for LG23%20XZX: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: FL21%20VDZ
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL21%2520VDZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:13 [bca.uk] INFO: Scrape type for FL21%20VDZ: 0
2026-03-28 11:06:13 [bca.uk] INFO: Found listing with ID: K321%20PXX
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27K321%2520PXX%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for K321%20PXX: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SB69%20LYC
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB69%2520LYC%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SB69%20LYC: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: NC23%20XLD
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC23%2520XLD%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for NC23%20XLD: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: DU17%20AZG
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520AZG%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for DU17%20AZG: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: X5%20GTD
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X5%2520GTD%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for X5%20GTD: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: CV64%20BKG
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520BKG%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for CV64%20BKG: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SG17%20PZK
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520PZK%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SG17%20PZK: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: YS67%20ATN
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS67%2520ATN%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for YS67%20ATN: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: VE17%20RTZ
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE17%2520RTZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for VE17%20RTZ: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SN63%20FMO
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520FMO%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SN63%20FMO: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SY63%20KOV
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520KOV%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SY63%20KOV: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SK70%20VVP
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK70%2520VVP%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SK70%20VVP: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SR70%20FBU
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR70%2520FBU%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SR70%20FBU: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: FD66%20JYF
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD66%2520JYF%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for FD66%20JYF: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: L8%20ULV
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L8%2520ULV%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for L8%20ULV: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: LL12%20SVJ
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL12%2520SVJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for LL12%20SVJ: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SL12%20ADV
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL12%2520ADV%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SL12%20ADV: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: GJ67%20OET
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ67%2520OET%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for GJ67%20OET: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: SL66%20WTO
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL66%2520WTO%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for SL66%20WTO: 0
2026-03-28 11:06:14 [bca.uk] INFO: Found listing with ID: EJ02%20EGU
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ02%2520EGU%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [bca.uk] INFO: Scrape type for EJ02%20EGU: 0
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088431%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088431 not downloaded yet
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813551%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813551 not downloaded yet
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797339%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797339 not downloaded yet
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802326%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802326 not downloaded yet
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698827997%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827997 not downloaded yet
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775782%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775782 not downloaded yet
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822410%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822410 not downloaded yet
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9c3690>
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_expert_report_file_fe15bd0c-47e4-4656-9d5a-080fe999272e.pdf HTTP/1.1" 201 0
2026-03-28 11:06:14 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d734e44-52d9-57e4-8863-dc7d94854907, skipping ID generation
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPF65SSV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF65SSV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE
2026-03-28 11:06:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE
2026-03-28 11:06:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8812022e-2c81-54c5-9257-d256cd76a478 with identifier: MM14%20NXE to the API
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MM14%20NXE-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8812022e-2c81-54c5-9257-d256cd76a478',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MM14 NXE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MM14%20NXE&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'RENAULT',
'model': 'SCENIC',
'odometer': 39885,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'RENAULT SCENIC 1.5 DCI 110 DYNAMIQUE TOM TOM S/S MPV',
'transmission': 'manual',
'trim': 'DCI 110 DYNAMIQUE TOM TOM S/S',
'vin': 'VF1JZ14K650492134',
'year': 2014}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM14%2520NXE%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [bca.uk] INFO: Saving data for MM14%20NXE: {'auction_closing_time': 1774778400.0, 'created_time': 1774479425.815408, 'last_price_update_time': 1774695975.049241}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MM14%2520NXE') HTTP/1.1" 204 0
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797325%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797325 not downloaded yet
2026-03-28 11:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822593/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:15 [bca.uk] INFO: Found listing with ID: YW15%20NRU
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW15%2520NRU%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [bca.uk] INFO: Scrape type for YW15%20NRU: 0
2026-03-28 11:06:15 [bca.uk] INFO: Found listing with ID: EY70%20RUA
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY70%2520RUA%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [bca.uk] INFO: Scrape type for EY70%20RUA: 0
2026-03-28 11:06:15 [bca.uk] INFO: Found listing with ID: ET12%20EPJ
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [bca.uk] INFO: Scrape type for ET12%20EPJ: 2
2026-03-28 11:06:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ
2026-03-28 11:06:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 92d9f631-3241-542e-8b27-05b21b10e4fb with scrape type 2
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 92d9f631-3241-542e-8b27-05b21b10e4fb with scrape type 2
2026-03-28 11:06:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 92d9f631-3241-542e-8b27-05b21b10e4fb, identifier: ET12%20EPJ
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D694088439%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088439 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698813574%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813574 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797351%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797351 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802345%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802345 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698828001%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828001 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775798%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775798 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822432%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822432 not downloaded yet
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910892%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910892 not downloaded yet
2026-03-28 11:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YP18HSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088396/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ
2026-03-28 11:06:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ
2026-03-28 11:06:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 92d9f631-3241-542e-8b27-05b21b10e4fb with identifier: ET12%20EPJ to the API
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 179,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ET12%20EPJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '92d9f631-3241-542e-8b27-05b21b10e4fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ET12 EPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ET12%20EPJ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'KUGA',
'odometer': 118801,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM X P/SHFT StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM X P/SHFT',
'vin': 'WF0RXXGCDRCD65267',
'year': 2012}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET12%2520EPJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:15 [bca.uk] INFO: Saving data for ET12%20EPJ: {'auction_closing_time': 1774778400.0, 'created_time': 1774448778.412118, 'last_price_update_time': 1774695975.98538}
2026-03-28 11:06:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ET12%2520EPJ') HTTP/1.1" 204 0
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797337%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797337 not downloaded yet
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac13ee50>
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_expert_report_file_2b65c788-dca3-4dbe-a88f-5b8180a9bdcd.pdf HTTP/1.1" 201 0
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3, skipping ID generation
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNG13GKJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NG13GKJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd3d10>
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_expert_report_file_24c02b55-db0b-4514-ab0a-4813992ab63e.pdf HTTP/1.1" 201 0
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65008501-d7e3-5111-b4f9-a8e8adb781bc, skipping ID generation
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMF64ZPZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF64ZPZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822371>
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:16 [bca.uk] INFO: Found listing with ID: DY59%20NHM
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520NHM%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [bca.uk] INFO: Scrape type for DY59%20NHM: 2
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87480faa-88cc-50d5-8c30-0f2179666de8 with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87480faa-88cc-50d5-8c30-0f2179666de8 with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87480faa-88cc-50d5-8c30-0f2179666de8, identifier: DY59%20NHM
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797362%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797362 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802365%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802365 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698828006%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828006 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775823%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775823 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822455%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822455 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910904%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910904 not downloaded yet
2026-03-28 11:06:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM
2026-03-28 11:06:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM
2026-03-28 11:06:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87480faa-88cc-50d5-8c30-0f2179666de8 with identifier: DY59%20NHM to the API
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 155,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DY59%20NHM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '87480faa-88cc-50d5-8c30-0f2179666de8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DY59 NHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DY59%20NHM&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 114154,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 VVT 115 ACTIVE Hatchback',
'transmission': 'manual',
'trim': 'VVT 115 ACTIVE',
'vin': 'W0L0AHL48A5001425',
'year': 2009}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY59%2520NHM%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [bca.uk] INFO: Saving data for DY59%20NHM: {'auction_closing_time': 1774778400.0, 'created_time': 1774476139.808474, 'last_price_update_time': 1774695976.812077}
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DY59%2520NHM') HTTP/1.1" 204 0
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797347%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797347 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775717%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775717 not downloaded yet
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698766975%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766975 not downloaded yet
2026-03-28 11:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822389/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822389>
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797314/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797314>
2026-03-28 11:06:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:16 [bca.uk] INFO: Found listing with ID: DF63%20NXU
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF63%2520NXU%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [bca.uk] INFO: Scrape type for DF63%20NXU: 0
2026-03-28 11:06:16 [bca.uk] INFO: Found listing with ID: BL62%20FPF
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL62%2520FPF%27 HTTP/1.1" 200 None
2026-03-28 11:06:16 [bca.uk] INFO: Scrape type for BL62%20FPF: 2
2026-03-28 11:06:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e with identifier: BL62%20FPF
2026-03-28 11:06:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e with scrape type 2
2026-03-28 11:06:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e, identifier: BL62%20FPF
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797377%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797377 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802390%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802390 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698828012%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828012 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775862%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775862 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822491%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822491 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910908%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910908 not downloaded yet
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2f6f90>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813381%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813381/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc24450>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813390%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813390/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac182050>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088388%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088388/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fa290>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822593%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822593/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac180890>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813401%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813401/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc59fd0>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088396%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088396/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe3fcd0>
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088392%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088392/600 saved to cache
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775764/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775764>
2026-03-28 11:06:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827989/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827989>
2026-03-28 11:06:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e with identifier: BL62%20FPF
2026-03-28 11:06:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e with identifier: BL62%20FPF
2026-03-28 11:06:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e with identifier: BL62%20FPF to the API
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL62%20FPF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'cf4cbcc6-6f92-527a-a8cf-2e8e24a1042e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL62 FPF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL62%20FPF&vehicleType=*',
'listing': 'auction',
'location': 'Newcastle-u-Tyne',
'make': 'FORD',
'model': 'KUGA',
'odometer': 64649,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 163 4WD TITANIUM X P/S StationWagon',
'transmission': 'automatic',
'trim': 'TDCI 163 4WD TITANIUM X P/S',
'vin': 'WF0AXXWPMACT57686',
'year': 2013}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL62%2520FPF%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [bca.uk] INFO: Saving data for BL62%20FPF: {'auction_closing_time': 1774864800.0, 'created_time': 1774101909.408146, 'last_price_update_time': 1774695977.697507}
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL62%2520FPF') HTTP/1.1" 204 0
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797359%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797359 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775719%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775719 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767002%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767002 not downloaded yet
2026-03-28 11:06:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:17 [bca.uk] INFO: Found listing with ID: YK17%20VSR
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK17%2520VSR%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [bca.uk] INFO: Scrape type for YK17%20VSR: 0
2026-03-28 11:06:17 [bca.uk] INFO: Found listing with ID: SK13%20JJZ
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520JJZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [bca.uk] INFO: Scrape type for SK13%20JJZ: 0
2026-03-28 11:06:17 [bca.uk] INFO: Found listing with ID: OE67%20PUF
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE67%2520PUF%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [bca.uk] INFO: Scrape type for OE67%20PUF: 2
2026-03-28 11:06:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d78d3b76-5e9d-5369-b184-df2fd6983a94 with identifier: OE67%20PUF
2026-03-28 11:06:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d78d3b76-5e9d-5369-b184-df2fd6983a94 with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d78d3b76-5e9d-5369-b184-df2fd6983a94 with scrape type 2
2026-03-28 11:06:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d78d3b76-5e9d-5369-b184-df2fd6983a94, identifier: OE67%20PUF
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797390%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797390 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802411%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802411 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698828020%27 HTTP/1.1" 200 None
2026-03-28 11:06:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828020 not downloaded yet
2026-03-28 11:06:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775899%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775899 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822519%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822519 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910914%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910914 not downloaded yet
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822410/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822410>
2026-03-28 11:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797325/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797325>
2026-03-28 11:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910878/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF65SSV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d78d3b76-5e9d-5369-b184-df2fd6983a94 with identifier: OE67%20PUF
2026-03-28 11:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d78d3b76-5e9d-5369-b184-df2fd6983a94 with identifier: OE67%20PUF
2026-03-28 11:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d78d3b76-5e9d-5369-b184-df2fd6983a94 with identifier: OE67%20PUF to the API
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OE67%20PUF-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd78d3b76-5e9d-5369-b184-df2fd6983a94',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OE67 PUF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OE67%20PUF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'JAGUAR',
'model': 'XE',
'odometer': 78803,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'JAGUAR XE 2.0 D 240 AWD R SPORT Saloon',
'transmission': 'automatic',
'trim': 'D 240 AWD R SPORT',
'vin': 'SAJAA4AN8JCP34003',
'year': 2017}
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE67%2520PUF%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [bca.uk] INFO: Saving data for OE67%20PUF: {'auction_closing_time': 1774864800.0, 'created_time': 1773907921.497516, 'last_price_update_time': 1774695978.401614}
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OE67%2520PUF') HTTP/1.1" 204 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797378%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797378 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775725%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775725 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767015%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767015 not downloaded yet
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd48950>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813410%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813410/600 saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4be50>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813424%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813424/600 saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fda9350>
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088400%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088400/600 saved to cache
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775782>
2026-03-28 11:06:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910892>
2026-03-28 11:06:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:18 [bca.uk] INFO: Found listing with ID: CK66%20VME
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK66%2520VME%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [bca.uk] INFO: Scrape type for CK66%20VME: 2
2026-03-28 11:06:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f3c646e3-4a57-537f-98f9-2650a6ff8da7 with identifier: CK66%20VME
2026-03-28 11:06:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f3c646e3-4a57-537f-98f9-2650a6ff8da7 with scrape type 2
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f3c646e3-4a57-537f-98f9-2650a6ff8da7 with scrape type 2
2026-03-28 11:06:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f3c646e3-4a57-537f-98f9-2650a6ff8da7, identifier: CK66%20VME
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797407%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797407 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802434%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802434 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698828028%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828028 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775931%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775931 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822543%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822543 not downloaded yet
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910921%27 HTTP/1.1" 200 None
2026-03-28 11:06:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910921 not downloaded yet
2026-03-28 11:06:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f3c646e3-4a57-537f-98f9-2650a6ff8da7 with identifier: CK66%20VME
2026-03-28 11:06:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f3c646e3-4a57-537f-98f9-2650a6ff8da7 with identifier: CK66%20VME
2026-03-28 11:06:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f3c646e3-4a57-537f-98f9-2650a6ff8da7 with identifier: CK66%20VME to the API
2026-03-28 11:06:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CK66%20VME-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f3c646e3-4a57-537f-98f9-2650a6ff8da7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CK66 VME',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CK66%20VME&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'GRAND C-MAX',
'odometer': 117163,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD GRAND C-MAX 1.5 TDCI 120 ZETEC P/S MPV',
'transmission': 'automatic',
'trim': 'TDCI 120 ZETEC P/S',
'vin': 'WF0WXXGCEWGY14544',
'year': 2016}
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK66%2520VME%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [bca.uk] INFO: Saving data for CK66%20VME: {'auction_closing_time': 1774864800.0, 'created_time': 1774101909.817417, 'last_price_update_time': 1774695979.164037}
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CK66%2520VME') HTTP/1.1" 204 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797392%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797392 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775731%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775731 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767030%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767030 not downloaded yet
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822389/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827989/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910904/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910904>
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797314/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822455>
2026-03-28 11:06:19 [bca.uk] INFO: Found listing with ID: LD75%20EHO
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD75%2520EHO%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [bca.uk] INFO: Scrape type for LD75%20EHO: 1
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9b95dd9-3469-5e6e-ba6a-02b349aae404 with identifier: LD75%20EHO
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797417%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797417 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802459%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802459 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698828037%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828037 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775957%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775957 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822574%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822574 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910945%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910945 not downloaded yet
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8bb90>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_expert_report_file_f01ba12f-1e03-4a53-90dc-4aa3a58f7875.pdf HTTP/1.1" 201 0
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6b222de-eba3-50da-a820-7f016bb30365, skipping ID generation
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDN60UCJ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN60UCJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4c1390>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_expert_report_file_3590e04d-9688-4a0a-8a3b-fe5856dc5d7d.pdf HTTP/1.1" 201 0
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9108cc1a-a955-5b82-8aab-ca366edb3cb0, skipping ID generation
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFD20CUW-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD20CUW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff48210>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822357%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822357/600 saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775764/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910878/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698766975>
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797411%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797411 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775738%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775738 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767042%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767042 not downloaded yet
2026-03-28 11:06:19 [bca.uk] INFO: Found listing with ID: BU74%20UXT
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU74%2520UXT%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [bca.uk] INFO: Scrape type for BU74%20UXT: 1
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5bf22baa-f479-58ee-abe9-b4001391a16b with identifier: BU74%20UXT
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910963%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910963 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758490%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758490 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802218%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802218 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698797427%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797427 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775765%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775765 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767070%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767070 not downloaded yet
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4c0e50>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822371%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822371/600 saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea16710>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822389%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822389/600 saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4e7d0>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698827989%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827989/600 saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b1210>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797314%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797314/600 saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797325/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775719/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775719>
2026-03-28 11:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767002/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767002>
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822410/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910914>
2026-03-28 11:06:19 [bca.uk] INFO: Found listing with ID: LD63%20HAU
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD63%2520HAU%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [bca.uk] INFO: Scrape type for LD63%20HAU: 1
2026-03-28 11:06:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 65b13170-0be8-57ff-b675-7cab8dca779c with identifier: LD63%20HAU
2026-03-28 11:06:19 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910982%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910982 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758500%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758500 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802229%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802229 not downloaded yet
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775800%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775800 not downloaded yet
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767087%27 HTTP/1.1" 200 None
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767087 not downloaded yet
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdc8990>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775764%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775764/600 saved to cache
2026-03-28 11:06:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac413850>
2026-03-28 11:06:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910878%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910878/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:20 [bca.uk] INFO: Found listing with ID: AL11%20DAV
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AL11%2520DAV%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [bca.uk] INFO: Scrape type for AL11%20DAV: 0
2026-03-28 11:06:20 [bca.uk] INFO: Found listing with ID: LC13%20XXF
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC13%2520XXF%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [bca.uk] INFO: Scrape type for LC13%20XXF: 1
2026-03-28 11:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8e793e99-15e7-5980-8a88-4fddfbbe45da with identifier: LC13%20XXF
2026-03-28 11:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697910997%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910997 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758514%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758514 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802244%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802244 not downloaded yet
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910904/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767030/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767030>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910921>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822543>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775931>
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775843%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775843 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767101%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767101 not downloaded yet
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775731>
2026-03-28 11:06:20 [bca.uk] INFO: Found listing with ID: LR63%20VBU
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR63%2520VBU%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [bca.uk] INFO: Scrape type for LR63%20VBU: 1
2026-03-28 11:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 24590d65-22dc-5183-92ba-25ef3ccf3df6 with identifier: LR63%20VBU
2026-03-28 11:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758526%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758526 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802259%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802259 not downloaded yet
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac517d50>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797325%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797325/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d2cd0>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822410%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822410/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd306d0>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910892%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910892/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e241f90>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822455%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822455/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e894710>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775782%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775782/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775887%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775887 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698767118%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767118 not downloaded yet
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:20 [bca.uk] INFO: Found listing with ID: L14%20RHU
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L14%2520RHU%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [bca.uk] INFO: Scrape type for L14%20RHU: 1
2026-03-28 11:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ecc151e2-e760-5842-8b42-b03e39ce399c with identifier: L14%20RHU
2026-03-28 11:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758538%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758538 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802278%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802278 not downloaded yet
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e862790>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910904%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910904/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9e63d0>
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698766975%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766975/600 saved to cache
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775719/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767002/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775765/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775765>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910963/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910963>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767070/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767070>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758490>
2026-03-28 11:06:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802218/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802218>
2026-03-28 11:06:20 [bca.uk] INFO: Found listing with ID: HK14%20ZDR
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK14%2520ZDR%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [bca.uk] INFO: Scrape type for HK14%20ZDR: 1
2026-03-28 11:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e with identifier: HK14%20ZDR
2026-03-28 11:06:20 [crawlers.middlewares.report_download_middleware] INFO: Downloading car_expert_report_source_url for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758553%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758553 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802316%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802316 not downloaded yet
2026-03-28 11:06:20 [bca.uk] INFO: Found listing with ID: MA68%20OAS
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA68%2520OAS%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [bca.uk] INFO: Scrape type for MA68%20OAS: 2
2026-03-28 11:06:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a33cb74c-d10f-5f2c-8138-807f2719c46a with identifier: MA68%20OAS
2026-03-28 11:06:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a33cb74c-d10f-5f2c-8138-807f2719c46a with scrape type 2
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a33cb74c-d10f-5f2c-8138-807f2719c46a with scrape type 2
2026-03-28 11:06:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a33cb74c-d10f-5f2c-8138-807f2719c46a, identifier: MA68%20OAS
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758566%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758566 not downloaded yet
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802351%27 HTTP/1.1" 200 None
2026-03-28 11:06:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802351 not downloaded yet
2026-03-28 11:06:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffca590>
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910914%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910914/600 saved to cache
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a33cb74c-d10f-5f2c-8138-807f2719c46a with identifier: MA68%20OAS
2026-03-28 11:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a33cb74c-d10f-5f2c-8138-807f2719c46a with identifier: MA68%20OAS
2026-03-28 11:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a33cb74c-d10f-5f2c-8138-807f2719c46a with identifier: MA68%20OAS to the API
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 157,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA68%20OAS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-04T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'a33cb74c-d10f-5f2c-8138-807f2719c46a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA68 OAS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA68%20OAS&vehicleType=*',
'listing': 'directbuy',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 75761,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 11500,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D180 R-DYNAMIC S StationWagon',
'transmission': 'automatic',
'trim': 'D180 R-DYNAMIC S',
'vin': 'SALYA2AN7KA793955',
'year': 2018}
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA68%2520OAS%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [bca.uk] INFO: Saving data for MA68%20OAS: {'auction_closing_time': 1775286000.0, 'created_time': 1774436900.04912, 'last_price_update_time': 1774695981.41969}
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA68%2520OAS') HTTP/1.1" 204 0
2026-03-28 11:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758514/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758514>
2026-03-28 11:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802244>
2026-03-28 11:06:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767118>
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767030/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:21 [bca.uk] INFO: Found listing with ID: YN18%20XLF
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [bca.uk] INFO: Scrape type for YN18%20XLF: 2
2026-03-28 11:06:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7e61802f-768a-52df-941a-3b6f42bc99f3 with identifier: YN18%20XLF
2026-03-28 11:06:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7e61802f-768a-52df-941a-3b6f42bc99f3 with scrape type 2
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7e61802f-768a-52df-941a-3b6f42bc99f3 with scrape type 2
2026-03-28 11:06:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7e61802f-768a-52df-941a-3b6f42bc99f3, identifier: YN18%20XLF
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758582%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758582 not downloaded yet
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802381%27 HTTP/1.1" 200 None
2026-03-28 11:06:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802381 not downloaded yet
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7e61802f-768a-52df-941a-3b6f42bc99f3 with identifier: YN18%20XLF
2026-03-28 11:06:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7e61802f-768a-52df-941a-3b6f42bc99f3 with identifier: YN18%20XLF
2026-03-28 11:06:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7e61802f-768a-52df-941a-3b6f42bc99f3 with identifier: YN18%20XLF to the API
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YN18%20XLF-GB',
'category': 'LightCommercialVehicle',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-04T07:00:00Z',
'fuel_type': 'Diesel',
'id': '7e61802f-768a-52df-941a-3b6f42bc99f3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YN18 XLF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YN18%20XLF&vehicleType=*',
'listing': 'directbuy',
'location': 'Leeds',
'make': 'VOLKSWAGEN',
'model': 'TRANSPORTER T28',
'odometer': 88096,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 8500,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TRANSPORTER T28 2.0 TDI 102 BMT S/L LWB PanelVan',
'transmission': 'manual',
'trim': 'TDI 102 BMT S/L LWB',
'vin': 'WV1ZZZ7HZJH118986',
'year': 2018}
2026-03-28 11:06:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [bca.uk] INFO: Saving data for YN18%20XLF: {'auction_closing_time': 1775286000.0, 'created_time': 1773843752.686475, 'last_price_update_time': 1774695982.001994}
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YN18%2520XLF') HTTP/1.1" 204 0
2026-03-28 11:06:22 [bca.uk] INFO: Found listing with ID: OE23%20DFP
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520DFP%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [bca.uk] INFO: Scrape type for OE23%20DFP: 0
2026-03-28 11:06:22 [bca.uk] INFO: Found listing with ID: KE71%20OYG
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE71%2520OYG%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [bca.uk] INFO: Scrape type for KE71%20OYG: 2
2026-03-28 11:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e1323954-8f60-56b9-b54c-9b8ed2130802 with identifier: KE71%20OYG
2026-03-28 11:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e1323954-8f60-56b9-b54c-9b8ed2130802 with scrape type 2
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e1323954-8f60-56b9-b54c-9b8ed2130802 with scrape type 2
2026-03-28 11:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e1323954-8f60-56b9-b54c-9b8ed2130802, identifier: KE71%20OYG
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698758599%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758599 not downloaded yet
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802409%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802409 not downloaded yet
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758490/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802278>
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802218/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e1323954-8f60-56b9-b54c-9b8ed2130802 with identifier: KE71%20OYG
2026-03-28 11:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e1323954-8f60-56b9-b54c-9b8ed2130802 with identifier: KE71%20OYG
2026-03-28 11:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e1323954-8f60-56b9-b54c-9b8ed2130802 with identifier: KE71%20OYG to the API
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KE71%20OYG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Electric',
'id': 'e1323954-8f60-56b9-b54c-9b8ed2130802',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'KE71 OYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KE71%20OYG&vehicleType=*',
'listing': 'directbuy',
'location': 'Leeds',
'make': 'MERCEDES-BENZ',
'model': 'EQA 250',
'odometer': 87643,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 13000,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ EQA 250 140KW 66.5KWH AMG LINE Hatchback',
'transmission': 'automatic',
'trim': '140KW 66.5KWH AMG LINE',
'vin': 'W1N2437012J020480',
'year': 2021}
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE71%2520OYG%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [bca.uk] INFO: Saving data for KE71%20OYG: {'auction_closing_time': 1774854000.0, 'created_time': 1774264592.061562, 'last_price_update_time': 1774695982.520817}
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KE71%2520OYG') HTTP/1.1" 204 0
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc9f50>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775719%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775719/600 saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a7910>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767002%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767002/600 saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac352110>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775731%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775731/600 saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1df90>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767030%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767030/600 saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2cd8d0>
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910921%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910921/600 saved to cache
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758538/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758538>
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775765/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767070/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910963/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:22 [bca.uk] INFO: Found listing with ID: GU23%20RCX
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU23%2520RCX%27 HTTP/1.1" 200 None
2026-03-28 11:06:22 [bca.uk] INFO: Scrape type for GU23%20RCX: 2
2026-03-28 11:06:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: abb8b77c-d41d-5eec-8c51-9c69133d3ebd with identifier: GU23%20RCX
2026-03-28 11:06:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item abb8b77c-d41d-5eec-8c51-9c69133d3ebd with scrape type 2
2026-03-28 11:06:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item abb8b77c-d41d-5eec-8c51-9c69133d3ebd with scrape type 2
2026-03-28 11:06:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: abb8b77c-d41d-5eec-8c51-9c69133d3ebd, identifier: GU23%20RCX
2026-03-28 11:06:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: abb8b77c-d41d-5eec-8c51-9c69133d3ebd with identifier: GU23%20RCX
2026-03-28 11:06:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: abb8b77c-d41d-5eec-8c51-9c69133d3ebd with identifier: GU23%20RCX
2026-03-28 11:06:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: abb8b77c-d41d-5eec-8c51-9c69133d3ebd with identifier: GU23%20RCX to the API
2026-03-28 11:06:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU23%20RCX-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '0.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Electric',
'id': 'abb8b77c-d41d-5eec-8c51-9c69133d3ebd',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU23 RCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU23%20RCX&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'MAXUS',
'model': 'E DELIVER 9 FWD',
'odometer': 23580,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'MAXUS E DELIVER 9 FWD 150KW 65KWH L2 Luton',
'transmission': 'automatic',
'trim': '150KW 65KWH L2',
'vin': 'LSFAL1108MA158465',
'year': 2023}
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU23%2520RCX%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [bca.uk] INFO: Saving data for GU23%20RCX: {'auction_closing_time': 1774854000.0, 'created_time': 1774478103.802531, 'last_price_update_time': 1774695983.191932}
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU23%2520RCX') HTTP/1.1" 204 0
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc86550>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775931%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775931/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e7650>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822543%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822543/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758514/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802351>
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:23 [bca.uk] INFO: Found listing with ID: KS67%20YMP
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS67%2520YMP%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [bca.uk] INFO: Scrape type for KS67%20YMP: 2
2026-03-28 11:06:23 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 380e0089-61b2-5bff-975b-cfddbf579a06 with identifier: KS67%20YMP
2026-03-28 11:06:23 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 380e0089-61b2-5bff-975b-cfddbf579a06 with scrape type 2
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 380e0089-61b2-5bff-975b-cfddbf579a06 with scrape type 2
2026-03-28 11:06:23 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 380e0089-61b2-5bff-975b-cfddbf579a06, identifier: KS67%20YMP
2026-03-28 11:06:23 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 380e0089-61b2-5bff-975b-cfddbf579a06 with identifier: KS67%20YMP
2026-03-28 11:06:23 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 380e0089-61b2-5bff-975b-cfddbf579a06 with identifier: KS67%20YMP
2026-03-28 11:06:23 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 380e0089-61b2-5bff-975b-cfddbf579a06 with identifier: KS67%20YMP to the API
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:23 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=7&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KS67%20YMP-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Diesel',
'id': '380e0089-61b2-5bff-975b-cfddbf579a06',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'KS67 YMP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KS67%20YMP&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 70087,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D240 R-DYNAMIC HSE StationWagon',
'transmission': 'automatic',
'trim': 'D240 R-DYNAMIC HSE',
'vin': 'SALYA2AN8JA731138',
'year': 2017}
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS67%2520YMP%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [bca.uk] INFO: Saving data for KS67%20YMP: {'auction_closing_time': 1774940400.0, 'created_time': 1774365495.713388, 'last_price_update_time': 1774695983.739328}
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KS67%2520YMP') HTTP/1.1" 204 0
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e4050>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758490%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758490/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac476e10>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802218%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802218/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac352cd0>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775765%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775765/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc3f290>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767070%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767070/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2cf090>
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910963%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910963/600 saved to cache
2026-03-28 11:06:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802316/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802316>
2026-03-28 11:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758553/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758553>
2026-03-28 11:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK14%20ZDR-GB>
2026-03-28 11:06:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758566/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758566>
2026-03-28 11:06:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:23 [bca.uk] INFO: Found listing with ID: LL21%20EHM
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL21%2520EHM%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [bca.uk] INFO: Scrape type for LL21%20EHM: 0
2026-03-28 11:06:23 [bca.uk] INFO: Found listing with ID: RF68%20KUV
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520KUV%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [bca.uk] INFO: Scrape type for RF68%20KUV: 0
2026-03-28 11:06:23 [bca.uk] INFO: Found listing with ID: RV18%20ZFG
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520ZFG%27 HTTP/1.1" 200 None
2026-03-28 11:06:23 [bca.uk] INFO: Scrape type for RV18%20ZFG: 0
2026-03-28 11:06:23 [bca.uk] INFO: Found listing with ID: VO14%20OTM
2026-03-28 11:06:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO14%2520OTM%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [bca.uk] INFO: Scrape type for VO14%20OTM: 0
2026-03-28 11:06:24 [bca.uk] INFO: Found listing with ID: HW19%20NFU
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW19%2520NFU%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [bca.uk] INFO: Scrape type for HW19%20NFU: 0
2026-03-28 11:06:24 [bca.uk] INFO: Found listing with ID: PX65%20UKM
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX65%2520UKM%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [bca.uk] INFO: Scrape type for PX65%20UKM: 0
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd33d90>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767118%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767118/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758538/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758582>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802381>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffe9ad0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758514%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758514/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0d310>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802244%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802244/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e422e50>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802278%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802278/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802409>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775887/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775887>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758599/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758599>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e422350>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758538%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758538/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758566/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4b1d0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802351%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802351/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802259/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802259>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758526>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758553/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fc5d0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758566%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758566/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L14%20RHU-GB>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR63%20VBU-GB>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802316/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767101/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767101>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775887/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758599/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2cc10>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758553%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758553/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775843/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775843>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910997>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802259/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9aba50>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802381%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802381/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767087>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC13%20XXF-GB>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffeb8d0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802316%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802316/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaba050>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758582%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758582/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d0a10>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775887%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775887/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac16aed0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758599%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758599/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775800/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775800>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698758500>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910982/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910982>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802229>
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767101/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e625010>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758526%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758526/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fec84d0>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802259%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802259/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eab6810>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802409%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802409/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc88b90>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_expert_report_file_cc333920-b2e3-4152-a06e-46963fb2654d.pdf HTTP/1.1" 201 0
2026-03-28 11:06:24 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:24 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e, skipping ID generation
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DHK14ZDR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK14ZDR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797427>
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD63%20HAU-GB>
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648350%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648350 not downloaded yet
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775843/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648352%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648352 not downloaded yet
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa6910>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767101%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767101/600 saved to cache
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648354%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648354 not downloaded yet
2026-03-28 11:06:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767042/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767042>
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648355%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648355 not downloaded yet
2026-03-28 11:06:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU74%20UXT-GB>
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648356%27 HTTP/1.1" 200 None
2026-03-28 11:06:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648356 not downloaded yet
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c8b10>
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_expert_report_file_090d69b0-54df-453c-a7a6-7c2209af02cc.pdf HTTP/1.1" 201 0
2026-03-28 11:06:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecc151e2-e760-5842-8b42-b03e39ce399c, skipping ID generation
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DL14RHU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=L14RHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648359%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648359 not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775800/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775738>
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910982/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764573%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764573 not downloaded yet
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac517250>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775843%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775843/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb7d890>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910997%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910997/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e09d0>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_expert_report_file_06de8837-efe7-4464-a099-54ff86f5fdcd.pdf HTTP/1.1" 201 0
2026-03-28 11:06:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24590d65-22dc-5183-92ba-25ef3ccf3df6, skipping ID generation
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLR63VBU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR63VBU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648361%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648361 not downloaded yet
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648349/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=HK14ZDR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764586%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764586 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538863%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538863 not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e6710>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_expert_report_file_6b9f3c89-3a87-4adc-8936-db4a2359159c.pdf HTTP/1.1" 201 0
2026-03-28 11:06:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e793e99-15e7-5980-8a88-4fddfbbe45da, skipping ID generation
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLC13XXF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC13XXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffdb750>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802229%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802229/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648368%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648368 not downloaded yet
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802212/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FD20CUW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648350>
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648352>
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797411>
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767042/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764598%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764598 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538871%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538871 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723885%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723885 not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e239450>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758500%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758500/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc08e90>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775800%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775800/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfb2d0>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767087%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767087/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e863150>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910982%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910982/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697648371%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648371 not downloaded yet
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce0bd0>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797427%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797427/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648354/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648354>
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764610%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764610 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538884%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538884 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723891%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723891 not downloaded yet
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648349/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac244090>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_expert_report_file_095fc8ea-6979-4bd7-9a59-a54826f57ec8.pdf HTTP/1.1" 201 0
2026-03-28 11:06:25 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65b13170-0be8-57ff-b675-7cab8dca779c, skipping ID generation
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD63HAU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD63HAU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfa5d0>
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767042%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767042/600 saved to cache
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648356/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648356>
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648355>
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764560/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=L14RHU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DN60UCJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764617%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764617 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538892%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538892 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723896%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723896 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587793%27 HTTP/1.1" 200 None
2026-03-28 11:06:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587793 not downloaded yet
2026-03-28 11:06:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764636%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764636 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538906%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538906 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723902%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723902 not downloaded yet
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb002d0>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775738%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775738/600 saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648361/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648361>
2026-03-28 11:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR63VBU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587806%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587806 not downloaded yet
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802212/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FD20CUW/42808182?sv=2020-08-04&st=2026-03-28T11%3A06%3A12Z&se=2026-03-28T11%3A31%3A12Z&sr=b&sp=r&sig=LpfcZ7N4F9y8JfPeLDGvVsqUu%2FFiv4T%2FcCcsuGI1nr0%3D)
2026-03-28 11:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LC13XXF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648354/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764658%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764658 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538924%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538924 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723912%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723912 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587827%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587827 not downloaded yet
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc2b90>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648349%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648349/600 saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe86a90>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_expert_report_file_624d162e-a43c-450b-a8e9-4751eee72132.pdf HTTP/1.1" 201 0
2026-03-28 11:06:26 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bf22baa-f479-58ee-abe9-b4001391a16b, skipping ID generation
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBU74UXT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU74UXT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DN60UCJ/42807094?sv=2020-08-04&st=2026-03-28T11%3A06%3A10Z&se=2026-03-28T11%3A31%3A10Z&sr=b&sp=r&sig=BQODwxKkI2xsHGPana0gbBov66ZCb6XFm2LO7hsMb5A%3D)
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764676%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764676 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538949%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538949 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723923%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723923 not downloaded yet
2026-03-28 11:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723885/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723885>
2026-03-28 11:06:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648371/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648371>
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587841%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587841 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912796%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912796 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698764688%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764688 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538960%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538960 not downloaded yet
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723931%27 HTTP/1.1" 200 None
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723931 not downloaded yet
2026-03-28 11:06:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb24a90>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797411%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797411/600 saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07dd0>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648352%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648352/600 saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07310>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFD20CUW%252F698802212%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802212/600 saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0
2026-03-28 11:06:26 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9108cc1a-a955-5b82-8aab-ca366edb3cb0, skipping ID generation
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9108cc1a-a955-5b82-8aab-ca366edb3cb0 sending to next pipeline
2026-03-28 11:06:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9108cc1a-a955-5b82-8aab-ca366edb3cb0, identifier: FD20%20CUW
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4a110>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648354%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648354/600 saved to cache
2026-03-28 11:06:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4aa310>
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648350%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648350/600 saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764560/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723891/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723891>
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587856%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587856 not downloaded yet
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912824%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912824 not downloaded yet
2026-03-28 11:06:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9108cc1a-a955-5b82-8aab-ca366edb3cb0 with identifier: FD20%20CUW
2026-03-28 11:06:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9108cc1a-a955-5b82-8aab-ca366edb3cb0 with identifier: FD20%20CUW
2026-03-28 11:06:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9108cc1a-a955-5b82-8aab-ca366edb3cb0 with identifier: FD20%20CUW to the API
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802212/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_expert_report_file_3590e04d-9688-4a0a-8a3b-fe5856dc5d7d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FD20%20CUW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '9108cc1a-a955-5b82-8aab-ca366edb3cb0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FD20 CUW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FD20%20CUW&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 25636,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47752,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802212/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46070,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802218/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42831,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44317,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802259/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80119,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802316/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65938,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84743,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9108cc1a-a955-5b82-8aab-ca366edb3cb0/9108cc1a-a955-5b82-8aab-ca366edb3cb0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75250,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FD20CUW/698802409/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.5 TD 120 ECOTEC SPORT S/S Hatchback',
'transmission': 'automatic',
'trim': 'TD 120 ECOTEC SPORT S/S',
'vin': 'W0V7D9EJ2L4053357',
'year': 2020}
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD20%2520CUW%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [bca.uk] INFO: Saving data for FD20%20CUW: {'created_time': 1774695987.677542, 'last_price_update_time': 1774695987.677553, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FD20%2520CUW') HTTP/1.1" 204 0
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648356/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648361/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698538968%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538968 not downloaded yet
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723938%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723938 not downloaded yet
2026-03-28 11:06:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587793/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587793>
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587882%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587882 not downloaded yet
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912847%27 HTTP/1.1" 200 None
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912847 not downloaded yet
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac40ec90>
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDN60UCJ%252F698758482%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758482/600 saved to cache
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item d6b222de-eba3-50da-a820-7f016bb30365
2026-03-28 11:06:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d6b222de-eba3-50da-a820-7f016bb30365, skipping ID generation
2026-03-28 11:06:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d6b222de-eba3-50da-a820-7f016bb30365 sending to next pipeline
2026-03-28 11:06:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d6b222de-eba3-50da-a820-7f016bb30365, identifier: DN60%20UCJ
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698723946%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723946 not downloaded yet
2026-03-28 11:06:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d6b222de-eba3-50da-a820-7f016bb30365 with identifier: DN60%20UCJ
2026-03-28 11:06:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d6b222de-eba3-50da-a820-7f016bb30365 with identifier: DN60%20UCJ
2026-03-28 11:06:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d6b222de-eba3-50da-a820-7f016bb30365 with identifier: DN60%20UCJ to the API
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758482/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_expert_report_file_f01ba12f-1e03-4a53-90dc-4aa3a58f7875.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DN60%20UCJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd6b222de-eba3-50da-a820-7f016bb30365',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DN60 UCJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DN60%20UCJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'CITROEN',
'model': 'C1',
'odometer': 112673,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46707,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758490/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758514/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42095,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758538/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758553/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758566/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71097,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d6b222de-eba3-50da-a820-7f016bb30365/d6b222de-eba3-50da-a820-7f016bb30365_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62515,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DN60UCJ/698758599/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 VTR Hatchback',
'transmission': 'manual',
'trim': 'VTR',
'vin': 'VF7PMCFB489514998',
'year': 2011}
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN60%2520UCJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [bca.uk] INFO: Saving data for DN60%20UCJ: {'created_time': 1774695988.444124, 'last_price_update_time': 1774695988.444139, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DN60%2520UCJ') HTTP/1.1" 204 0
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538906>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723902/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723902>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587806/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587806>
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587906%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587906 not downloaded yet
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912872%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912872 not downloaded yet
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e423f10>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764560%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764560/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e961710>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538856%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538856/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723891/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723885/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764636>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723912/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723912>
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648371/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587929%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587929 not downloaded yet
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912888%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912888 not downloaded yet
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc51e90>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648355%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648355/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea89c90>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648356%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648356/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4e8dd0>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648361%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648361/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94af4c0190>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723877%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723877/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587793/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587841/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587841>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912796/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912796>
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698587948%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587948 not downloaded yet
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912915%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912915 not downloaded yet
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe86210>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723891%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723891/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf7590>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723885%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723885/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd9490>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648371%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648371/600 saved to cache
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587806/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912953%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912953 not downloaded yet
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587856/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587856>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538960/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538960>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912824/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912824>
2026-03-28 11:06:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723931>
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723902/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723912/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912981%27 HTTP/1.1" 200 None
2026-03-28 11:06:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912981 not downloaded yet
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8eb290>
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587793%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587793/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698913003%27 HTTP/1.1" 200 None
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698913003 not downloaded yet
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723946>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912872/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912872>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587841/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912888/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912888>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587906>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e861490>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587806%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587806/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912796/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf60d0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723902%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723902/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2b3d0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723912%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723912/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae613e50>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538906%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538906/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912824/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587856/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587948/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587948>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587929/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587929>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912847/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912847>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912915/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912915>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538960/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8c84d0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587841%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587841/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac357b50>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764636%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764636/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac240250>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912796%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912796/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912872/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1d0d0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912824%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912824/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff60710>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587856%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587856/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b8c10>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538960%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538960/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb91090>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723931%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723931/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587882/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587882>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698913003/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698913003>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912981/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912981>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912953>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912888/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912915/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ea990>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912872%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912872/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723938/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723938>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587929/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538968/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538968>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587948/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2b4d0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912888%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912888/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912847/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723923>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764688/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764688>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538949>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698913003/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912981/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587882/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac352fd0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723946%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723946/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac5166d0>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587906%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587906/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e836650>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912915%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912915/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac516790>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587929%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587929/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac266210>
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587948%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587948/600 saved to cache
2026-03-28 11:06:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538924/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538924>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698587827>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764676/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764676>
2026-03-28 11:06:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BU74UXT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723938/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc3610>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912847%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912847/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e608810>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698913003%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698913003/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e239dd0>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912981%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912981/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff5f0d0>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587882%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587882/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09c350>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912953%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912953/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764658/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764658>
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538892>
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723896/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698723896>
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764688/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538968/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc52b50>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723938%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723938/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764617/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764617>
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BU74UXT/42809482?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=dHUl8P9QX5Ubhmb28LY3z5tpnMMR4QUBV5lw5RR7hXU%3D)
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587773/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD63HAU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538884/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538884>
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764610/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764610>
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97cad0>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764688%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764688/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723896/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LC13XXF/42805803?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=VeV7rl0sCcMaBi4lGAf3JNBmM%2FX9zzvj%2BwZG66n2vAc%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764676/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538924/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764658/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff60490>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723923%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723923/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc9bb90>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538949%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538949/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdcb990>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538968%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538968/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538871/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538871>
2026-03-28 11:06:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764598/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764598>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf6510>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBU74UXT%252F698912774%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912774/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 5bf22baa-f479-58ee-abe9-b4001391a16b
2026-03-28 11:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 5bf22baa-f479-58ee-abe9-b4001391a16b, skipping ID generation
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 5bf22baa-f479-58ee-abe9-b4001391a16b sending to next pipeline
2026-03-28 11:06:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5bf22baa-f479-58ee-abe9-b4001391a16b, identifier: BU74%20UXT
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e626010>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587827%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587827/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23ba10>
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLC13XXF%252F698723896%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723896/600 saved to cache
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8e793e99-15e7-5980-8a88-4fddfbbe45da
2026-03-28 11:06:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8e793e99-15e7-5980-8a88-4fddfbbe45da, skipping ID generation
2026-03-28 11:06:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8e793e99-15e7-5980-8a88-4fddfbbe45da sending to next pipeline
2026-03-28 11:06:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8e793e99-15e7-5980-8a88-4fddfbbe45da, identifier: LC13%20XXF
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ebf50>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538892%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538892/600 saved to cache
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97f910>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764676%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764676/600 saved to cache
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad152310>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538924%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538924/600 saved to cache
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:31 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4102d0>
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764658%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764658/600 saved to cache
2026-03-28 11:06:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5bf22baa-f479-58ee-abe9-b4001391a16b with identifier: BU74%20UXT
2026-03-28 11:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5bf22baa-f479-58ee-abe9-b4001391a16b with identifier: BU74%20UXT
2026-03-28 11:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5bf22baa-f479-58ee-abe9-b4001391a16b with identifier: BU74%20UXT to the API
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912774/600>
{'auction_title': '',
'c_o_2_emission_value': 222,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_expert_report_file_624d162e-a43c-450b-a8e9-4751eee72132.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BU74%20UXT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '3.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Diesel',
'id': '5bf22baa-f479-58ee-abe9-b4001391a16b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BU74 UXT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BU74%20UXT&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'DEFENDER 90',
'odometer': 13067,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44505,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912824/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44939,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912847/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42246,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912872/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912888/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73351,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912915/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87667,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698912981/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_5bf22baa-f479-58ee-abe9-b4001391a16b/5bf22baa-f479-58ee-abe9-b4001391a16b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 59991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BU74UXT/698913003/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'LAND ROVER DEFENDER 90 3.0 D250 AWD X-DYNAMIC HSE (5ST) '
'StationWagon',
'transmission': 'automatic',
'trim': 'D250 AWD X-DYNAMIC HSE (5ST)',
'vin': 'SALEA6AW1S2371354',
'year': 2024}
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU74%2520UXT%27 HTTP/1.1" 200 None
2026-03-28 11:06:31 [bca.uk] INFO: Saving data for BU74%20UXT: {'created_time': 1774695991.7523, 'last_price_update_time': 1774695991.75231, 'auction_closing_time': 1775124000.0}
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BU74%2520UXT') HTTP/1.1" 204 0
2026-03-28 11:06:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8e793e99-15e7-5980-8a88-4fddfbbe45da with identifier: LC13%20XXF
2026-03-28 11:06:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8e793e99-15e7-5980-8a88-4fddfbbe45da with identifier: LC13%20XXF
2026-03-28 11:06:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8e793e99-15e7-5980-8a88-4fddfbbe45da with identifier: LC13%20XXF to the API
2026-03-28 11:06:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723896/600>
{'auction_title': '',
'c_o_2_emission_value': 180,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_expert_report_file_6b9f3c89-3a87-4adc-8936-db4a2359159c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LC13%20XXF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8e793e99-15e7-5980-8a88-4fddfbbe45da',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LC13 XXF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LC13%20XXF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 63230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46241,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45761,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723885/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45081,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723891/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723896/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43439,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723902/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723912/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77146,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86084,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723938/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8e793e99-15e7-5980-8a88-4fddfbbe45da/8e793e99-15e7-5980-8a88-4fddfbbe45da_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LC13XXF/698723946/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.6 COOPER S ALL4 Hatchback',
'transmission': 'automatic',
'trim': 'COOPER S ALL4',
'vin': 'WMWZC52020WP81705',
'year': 2013}
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC13%2520XXF%27 HTTP/1.1" 200 None
2026-03-28 11:06:32 [bca.uk] INFO: Saving data for LC13%20XXF: {'created_time': 1774695992.180888, 'last_price_update_time': 1774695992.180899, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LC13%2520XXF') HTTP/1.1" 204 0
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764617/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587773/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD63HAU/42804114?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=XnHs7F%2B9LuMlKVm7zkLBon0wRy3x9KjtkZSfQYpA4ns%3D)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764610/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538863/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698538863>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764586/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764586>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648368/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648368>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698764573>
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538884/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775957/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775957>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822574>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697648359>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828037/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828037>
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764598/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538871/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910945/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910945>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4113d0>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764617%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764617/600 saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9dd10>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD63HAU%252F698587773%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587773/600 saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65b13170-0be8-57ff-b675-7cab8dca779c
2026-03-28 11:06:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65b13170-0be8-57ff-b675-7cab8dca779c, skipping ID generation
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65b13170-0be8-57ff-b675-7cab8dca779c sending to next pipeline
2026-03-28 11:06:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 65b13170-0be8-57ff-b675-7cab8dca779c, identifier: LD63%20HAU
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac240790>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764610%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764610/600 saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764586/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/L14RHU/42807269?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=NtjeeZVWoOlVi18AtQK6UtzvKt5CNHiBny0IQjkNGRc%3D)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:06:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 65b13170-0be8-57ff-b675-7cab8dca779c with identifier: LD63%20HAU
2026-03-28 11:06:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 65b13170-0be8-57ff-b675-7cab8dca779c with identifier: LD63%20HAU
2026-03-28 11:06:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 65b13170-0be8-57ff-b675-7cab8dca779c with identifier: LD63%20HAU to the API
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587773/600>
{'auction_title': '',
'c_o_2_emission_value': 251,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_expert_report_file_095fc8ea-6979-4bd7-9a59-a54826f57ec8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD63%20HAU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '4.8L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '65b13170-0be8-57ff-b675-7cab8dca779c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD63 HAU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD63%20HAU&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PORSCHE',
'model': 'CAYENNE',
'odometer': 91427,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587773/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587793/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587806/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50473,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587841/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587882/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88418,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587929/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65b13170-0be8-57ff-b675-7cab8dca779c/65b13170-0be8-57ff-b675-7cab8dca779c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77170,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD63HAU/698587948/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'PORSCHE CAYENNE 4.8 417 GTS TIPTRONIC S Estate',
'transmission': 'manual',
'trim': '417 GTS TIPTRONIC S',
'vin': 'WP1ZZZ92ZELA73704',
'year': 2013}
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD63%2520HAU%27 HTTP/1.1" 200 None
2026-03-28 11:06:32 [bca.uk] INFO: Saving data for LD63%20HAU: {'created_time': 1774695992.913957, 'last_price_update_time': 1774695992.913967, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD63%2520HAU') HTTP/1.1" 204 0
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797417/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797417>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD75%20EHO-GB>
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538863/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR63VBU/42802239?sv=2020-08-04&st=2026-03-28T11%3A06%3A24Z&se=2026-03-28T11%3A31%3A24Z&sr=b&sp=r&sig=ewmQL8ssU9VYAM%2BenvtvtdPZccPJVUthogBaR6mZnm4%3D)
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802459>
2026-03-28 11:06:32 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797392>
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648368/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:32 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8c990>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538884%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538884/600 saved to cache
2026-03-28 11:06:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffdb350>
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764598%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764598/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e834a50>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764573%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764573/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ba1d0>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538871%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538871/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd05610>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FL14RHU%252F698764586%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764586/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ecc151e2-e760-5842-8b42-b03e39ce399c
2026-03-28 11:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ecc151e2-e760-5842-8b42-b03e39ce399c, skipping ID generation
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ecc151e2-e760-5842-8b42-b03e39ce399c sending to next pipeline
2026-03-28 11:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ecc151e2-e760-5842-8b42-b03e39ce399c, identifier: L14%20RHU
2026-03-28 11:06:33 [bca.uk] INFO: Total items found: 100
2026-03-28 11:06:33 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded
2026-03-28 11:06:33 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:06:33 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:06:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775957/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ecc151e2-e760-5842-8b42-b03e39ce399c with identifier: L14%20RHU
2026-03-28 11:06:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ecc151e2-e760-5842-8b42-b03e39ce399c with identifier: L14%20RHU
2026-03-28 11:06:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ecc151e2-e760-5842-8b42-b03e39ce399c with identifier: L14%20RHU to the API
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764586/600>
{'auction_title': '',
'c_o_2_emission_value': 159,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_expert_report_file_090d69b0-54df-453c-a7a6-7c2209af02cc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=L14%20RHU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ecc151e2-e760-5842-8b42-b03e39ce399c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'L14 RHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=L14%20RHU&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 80652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56198,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764560/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 58007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 55487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764586/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53175,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764598/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48773,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764610/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49041,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764617/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85328,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764658/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764676/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ecc151e2-e760-5842-8b42-b03e39ce399c/ecc151e2-e760-5842-8b42-b03e39ce399c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77365,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/L14RHU/698764688/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TSI 300 R 4M DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 300 R 4M DSG',
'vin': 'WVWZZZAUZHW071530',
'year': 2016}
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L14%2520RHU%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [bca.uk] INFO: Saving data for L14%20RHU: {'created_time': 1774695993.68349, 'last_price_update_time': 1774695993.6835, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='L14%2520RHU') HTTP/1.1" 204 0
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4bb9d0>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR63VBU%252F698538863%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538863/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 24590d65-22dc-5183-92ba-25ef3ccf3df6
2026-03-28 11:06:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 24590d65-22dc-5183-92ba-25ef3ccf3df6, skipping ID generation
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 24590d65-22dc-5183-92ba-25ef3ccf3df6 sending to next pipeline
2026-03-28 11:06:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 24590d65-22dc-5183-92ba-25ef3ccf3df6, identifier: LR63%20VBU
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4c3f50>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648368%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648368/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:33 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd38c50>
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822574%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822574/600 saved to cache
2026-03-28 11:06:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797407/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797407>
2026-03-28 11:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802434>
2026-03-28 11:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698767015>
2026-03-28 11:06:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828028/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828028>
2026-03-28 11:06:33 [bca.uk] INFO: Found listing with ID: KP22%20FWN
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP22%2520FWN%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [bca.uk] INFO: Scrape type for KP22%20FWN: 0
2026-03-28 11:06:33 [bca.uk] INFO: Found listing with ID: YM70%20LGV
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM70%2520LGV%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [bca.uk] INFO: Scrape type for YM70%20LGV: 0
2026-03-28 11:06:33 [bca.uk] INFO: Found listing with ID: ST72%20HCC
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST72%2520HCC%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [bca.uk] INFO: Scrape type for ST72%20HCC: 0
2026-03-28 11:06:33 [bca.uk] INFO: Found listing with ID: BK70%20LBZ
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK70%2520LBZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:33 [bca.uk] INFO: Scrape type for BK70%20LBZ: 0
2026-03-28 11:06:33 [bca.uk] INFO: Found listing with ID: FE72%20GRU
2026-03-28 11:06:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE72%2520GRU%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for FE72%20GRU: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: FG19%20LHD
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520LHD%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for FG19%20LHD: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: FL70%20SXN
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL70%2520SXN%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for FL70%20SXN: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: GX69%20EEM
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520EEM%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for GX69%20EEM: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: SD18%20HLO
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD18%2520HLO%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for SD18%20HLO: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: AE23%20RSO
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE23%2520RSO%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for AE23%20RSO: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: AO71%20KYW
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO71%2520KYW%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for AO71%20KYW: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: AP18%20ZGH
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP18%2520ZGH%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for AP18%20ZGH: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: AX19%20VDY
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX19%2520VDY%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for AX19%20VDY: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: BG22%20JMV
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG22%2520JMV%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for BG22%20JMV: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: BJ23%20DSV
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ23%2520DSV%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for BJ23%20DSV: 0
2026-03-28 11:06:34 [bca.uk] INFO: Found listing with ID: BK22%20FCG
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK22%2520FCG%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Scrape type for BK22%20FCG: 2
2026-03-28 11:06:34 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b966e900-d150-5a77-bdf9-d2579a6dc902 with identifier: BK22%20FCG
2026-03-28 11:06:34 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b966e900-d150-5a77-bdf9-d2579a6dc902 with scrape type 2
2026-03-28 11:06:34 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b966e900-d150-5a77-bdf9-d2579a6dc902 with scrape type 2
2026-03-28 11:06:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b966e900-d150-5a77-bdf9-d2579a6dc902, identifier: BK22%20FCG
2026-03-28 11:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 24590d65-22dc-5183-92ba-25ef3ccf3df6 with identifier: LR63%20VBU
2026-03-28 11:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 24590d65-22dc-5183-92ba-25ef3ccf3df6 with identifier: LR63%20VBU
2026-03-28 11:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 24590d65-22dc-5183-92ba-25ef3ccf3df6 with identifier: LR63%20VBU to the API
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538863/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_expert_report_file_06de8837-efe7-4464-a099-54ff86f5fdcd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR63%20VBU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '24590d65-22dc-5183-92ba-25ef3ccf3df6',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR63 VBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR63%20VBU&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'SUZUKI',
'model': 'ALTO',
'odometer': 145979,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45865,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538856/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45830,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538863/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43311,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538871/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538884/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44553,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538924/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65604,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79856,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538960/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_24590d65-22dc-5183-92ba-25ef3ccf3df6/24590d65-22dc-5183-92ba-25ef3ccf3df6_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR63VBU/698538968/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'SUZUKI ALTO 1.0 SZ4 Hatchback',
'transmission': 'automatic',
'trim': 'SZ4',
'vin': 'MA3GFC31S00712591',
'year': 2013}
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR63%2520VBU%27 HTTP/1.1" 200 None
2026-03-28 11:06:34 [bca.uk] INFO: Saving data for LR63%20VBU: {'created_time': 1774695994.67764, 'last_price_update_time': 1774695994.677649, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR63%2520VBU') HTTP/1.1" 204 0
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828037/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910945/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/HK14ZDR/42786246?sv=2020-08-04&st=2026-03-28T11%3A06%3A23Z&se=2026-03-28T11%3A31%3A23Z&sr=b&sp=r&sig=pBTw0FElZgs4hftvbtPazinwnAS1y3YTN559QajA4t4%3D)
2026-03-28 11:06:34 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:06:34 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:06:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b966e900-d150-5a77-bdf9-d2579a6dc902 with identifier: BK22%20FCG
2026-03-28 11:06:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b966e900-d150-5a77-bdf9-d2579a6dc902 with identifier: BK22%20FCG
2026-03-28 11:06:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b966e900-d150-5a77-bdf9-d2579a6dc902 with identifier: BK22%20FCG to the API
2026-03-28 11:06:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK22%20FCG-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'b966e900-d150-5a77-bdf9-d2579a6dc902',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'BK22 FCG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK22%20FCG&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 32284,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 D165 2WD S Hatchback',
'transmission': 'manual',
'trim': 'D165 2WD S',
'vin': 'SALZB2CN4NH176037',
'year': 2022}
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK22%2520FCG%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Saving data for BK22%20FCG: {'auction_closing_time': 1774940400.0, 'created_time': 1774016035.954896, 'last_price_update_time': 1774695995.129017}
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK22%2520FCG') HTTP/1.1" 204 0
2026-03-28 11:06:35 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: BP73%20OOG
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520OOG%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for BP73%20OOG: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: CE19%20CEK
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520CEK%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for CE19%20CEK: 2
2026-03-28 11:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 14011602-5762-58d2-a829-496006fe978d with identifier: CE19%20CEK
2026-03-28 11:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 14011602-5762-58d2-a829-496006fe978d with scrape type 2
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 14011602-5762-58d2-a829-496006fe978d with scrape type 2
2026-03-28 11:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 14011602-5762-58d2-a829-496006fe978d, identifier: CE19%20CEK
2026-03-28 11:06:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 14011602-5762-58d2-a829-496006fe978d with identifier: CE19%20CEK
2026-03-28 11:06:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 14011602-5762-58d2-a829-496006fe978d with identifier: CE19%20CEK
2026-03-28 11:06:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 14011602-5762-58d2-a829-496006fe978d with identifier: CE19%20CEK to the API
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE19%20CEK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Electric',
'id': '14011602-5762-58d2-a829-496006fe978d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'CE19 CEK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE19%20CEK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'JAGUAR',
'model': 'I-PACE',
'odometer': 71529,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'JAGUAR I-PACE EV400 HSE Hatchback',
'transmission': 'automatic',
'trim': 'EV400 HSE',
'vin': 'SADHA2A1XK1F71826',
'year': 2019}
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE19%2520CEK%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Saving data for CE19%20CEK: {'auction_closing_time': 1774940400.0, 'created_time': 1773930133.664006, 'last_price_update_time': 1774695995.605927}
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE19%2520CEK') HTTP/1.1" 204 0
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3a810>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775957%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775957/600 saved to cache
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822519/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822519>
2026-03-28 11:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775899>
2026-03-28 11:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775725/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775725>
2026-03-28 11:06:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797378>
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: DP22%20TKE
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP22%2520TKE%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for DP22%20TKE: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: DS19%20NSN
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS19%2520NSN%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for DS19%20NSN: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: DS71%20EAY
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS71%2520EAY%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for DS71%20EAY: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: EA23%20BKN
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA23%2520BKN%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for EA23%20BKN: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: EY22%20KYZ
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY22%2520KYZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for EY22%20KYZ: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: FJ22%20YBP
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ22%2520YBP%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for FJ22%20YBP: 0
2026-03-28 11:06:35 [bca.uk] INFO: Found listing with ID: GN70%20XMW
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520XMW%27 HTTP/1.1" 200 None
2026-03-28 11:06:35 [bca.uk] INFO: Scrape type for GN70%20XMW: 2
2026-03-28 11:06:35 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e64134af-239f-5fc0-82fa-2baf621f4600 with identifier: GN70%20XMW
2026-03-28 11:06:35 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e64134af-239f-5fc0-82fa-2baf621f4600 with scrape type 2
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e64134af-239f-5fc0-82fa-2baf621f4600 with scrape type 2
2026-03-28 11:06:35 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e64134af-239f-5fc0-82fa-2baf621f4600, identifier: GN70%20XMW
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ec3d0>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698828037%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828037/600 saved to cache
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb81150>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910945%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910945/600 saved to cache
2026-03-28 11:06:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:35 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e513350>
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FHK14ZDR%252F697648359%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648359/600 saved to cache
2026-03-28 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e
2026-03-28 11:06:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e, skipping ID generation
2026-03-28 11:06:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e sending to next pipeline
2026-03-28 11:06:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e, identifier: HK14%20ZDR
2026-03-28 11:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797417/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:36 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e64134af-239f-5fc0-82fa-2baf621f4600 with identifier: GN70%20XMW
2026-03-28 11:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e64134af-239f-5fc0-82fa-2baf621f4600 with identifier: GN70%20XMW
2026-03-28 11:06:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e64134af-239f-5fc0-82fa-2baf621f4600 with identifier: GN70%20XMW to the API
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 196,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN70%20XMW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'e64134af-239f-5fc0-82fa-2baf621f4600',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN70 XMW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GN70%20XMW&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 44481,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 D240 R-DYNAMIC SE (7ST) StationWagon',
'transmission': 'automatic',
'trim': 'D240 R-DYNAMIC SE (7ST)',
'vin': 'SALCA2AN1LH874047',
'year': 2020}
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520XMW%27 HTTP/1.1" 200 None
2026-03-28 11:06:36 [bca.uk] INFO: Saving data for GN70%20XMW: {'auction_closing_time': 1774940400.0, 'created_time': 1773839093.722045, 'last_price_update_time': 1774695996.925511}
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GN70%2520XMW') HTTP/1.1" 204 0
2026-03-28 11:06:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e with identifier: HK14%20ZDR
2026-03-28 11:06:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e with identifier: HK14%20ZDR
2026-03-28 11:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e with identifier: HK14%20ZDR to the API
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648359/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_expert_report_file_cc333920-b2e3-4152-a06e-46963fb2654d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HK14%20ZDR-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HK14 ZDR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HK14%20ZDR&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 1,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 53442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648349/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54177,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648350/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648354/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48600,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49004,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648356/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77220,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648361/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78724,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e/1eb18c91-e05c-5b9a-a9d6-bd5e6d8bd76e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/HK14ZDR/697648371/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0CXXGAKCES55384',
'year': 2014}
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK14%2520ZDR%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [bca.uk] INFO: Saving data for HK14%20ZDR: {'created_time': 1774695997.356178, 'last_price_update_time': 1774695997.356188, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HK14%2520ZDR') HTTP/1.1" 204 0
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828020/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828020>
2026-03-28 11:06:37 [bca.uk] INFO: Found listing with ID: GX19%20TVF
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX19%2520TVF%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [bca.uk] INFO: Scrape type for GX19%20TVF: 0
2026-03-28 11:06:37 [bca.uk] INFO: Found listing with ID: HD22%20GPZ
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD22%2520GPZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [bca.uk] INFO: Scrape type for HD22%20GPZ: 2
2026-03-28 11:06:37 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 6229474a-5442-5925-8194-8112344f7cca with identifier: HD22%20GPZ
2026-03-28 11:06:37 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 6229474a-5442-5925-8194-8112344f7cca with scrape type 2
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 6229474a-5442-5925-8194-8112344f7cca with scrape type 2
2026-03-28 11:06:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6229474a-5442-5925-8194-8112344f7cca, identifier: HD22%20GPZ
2026-03-28 11:06:37 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:37 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:37 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:37 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe4810>
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797392%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797392/600 saved to cache
2026-03-28 11:06:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6229474a-5442-5925-8194-8112344f7cca with identifier: HD22%20GPZ
2026-03-28 11:06:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6229474a-5442-5925-8194-8112344f7cca with identifier: HD22%20GPZ
2026-03-28 11:06:37 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6229474a-5442-5925-8194-8112344f7cca with identifier: HD22%20GPZ to the API
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 57,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HD22%20GPZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '6229474a-5442-5925-8194-8112344f7cca',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'HD22 GPZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HD22%20GPZ&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 62327,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 P400E PHEV R-DYNAMIC HSE StationWagon',
'transmission': 'automatic',
'trim': 'P400E PHEV R-DYNAMIC HSE',
'vin': 'SALYA2AY1NA335505',
'year': 2022}
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD22%2520GPZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:37 [bca.uk] INFO: Saving data for HD22%20GPZ: {'auction_closing_time': 1774940400.0, 'created_time': 1774016034.419091, 'last_price_update_time': 1774695997.883359}
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HD22%2520GPZ') HTTP/1.1" 204 0
2026-03-28 11:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802411>
2026-03-28 11:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797390>
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828028/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797407/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: J4%20JYG
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J4%2520JYG%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for J4%20JYG: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: JR09%20HOG
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JR09%2520HOG%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for JR09%20HOG: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: KS69%20YCG
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520YCG%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for KS69%20YCG: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: LA71%20YYO
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA71%2520YYO%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for LA71%20YYO: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: LC22%20EAY
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC22%2520EAY%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for LC22%20EAY: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: LL22%20MGO
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL22%2520MGO%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for LL22%20MGO: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: LV22%20KXJ
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV22%2520KXJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for LV22%20KXJ: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: ML19%20OBE
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML19%2520OBE%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for ML19%20OBE: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: NC22%20CZK
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC22%2520CZK%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for NC22%20CZK: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: NX72%20PHY
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX72%2520PHY%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for NX72%20PHY: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: OV69%20LRU
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520LRU%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for OV69%20LRU: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: PX22%20ZKE
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX22%2520ZKE%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for PX22%20ZKE: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: PY67%20LKC
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY67%2520LKC%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for PY67%20LKC: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: RA15%20RYY
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520RYY%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for RA15%20RYY: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: RJ72%20VOD
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ72%2520VOD%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for RJ72%20VOD: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: SA21%20KZD
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA21%2520KZD%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for SA21%20KZD: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: SD71%20YFN
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD71%2520YFN%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for SD71%20YFN: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: SN22%20BGA
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN22%2520BGA%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for SN22%20BGA: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: SR23%20NZS
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR23%2520NZS%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for SR23%20NZS: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: ST09%20ARY
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST09%2520ARY%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for ST09%20ARY: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: ST18%20RTO
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST18%2520RTO%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for ST18%20RTO: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: SV21%20ZNZ
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV21%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for SV21%20ZNZ: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: SX22%20GDU
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SX22%2520GDU%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for SX22%20GDU: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: VX72%20WWK
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX72%2520WWK%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for VX72%20WWK: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: WK70%20HVS
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520HVS%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for WK70%20HVS: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: WU21%20EHW
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU21%2520EHW%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for WU21%20EHW: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: WU68%20BGK
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU68%2520BGK%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for WU68%20BGK: 0
2026-03-28 11:06:38 [bca.uk] INFO: Found listing with ID: WX22%20ZVD
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX22%2520ZVD%27 HTTP/1.1" 200 None
2026-03-28 11:06:38 [bca.uk] INFO: Scrape type for WX22%20ZVD: 2
2026-03-28 11:06:38 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9ea526c0-f83b-52a3-b1e0-78051b1bfab9 with identifier: WX22%20ZVD
2026-03-28 11:06:38 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9ea526c0-f83b-52a3-b1e0-78051b1bfab9 with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9ea526c0-f83b-52a3-b1e0-78051b1bfab9 with scrape type 2
2026-03-28 11:06:38 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9ea526c0-f83b-52a3-b1e0-78051b1bfab9, identifier: WX22%20ZVD
2026-03-28 11:06:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797359>
2026-03-28 11:06:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9ea526c0-f83b-52a3-b1e0-78051b1bfab9 with identifier: WX22%20ZVD
2026-03-28 11:06:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9ea526c0-f83b-52a3-b1e0-78051b1bfab9 with identifier: WX22%20ZVD
2026-03-28 11:06:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9ea526c0-f83b-52a3-b1e0-78051b1bfab9 with identifier: WX22%20ZVD to the API
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=10&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 239,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WX22%20ZVD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T07:00:00Z',
'fuel_type': 'Diesel',
'id': '9ea526c0-f83b-52a3-b1e0-78051b1bfab9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'WX22 ZVD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WX22%20ZVD&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 53920,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 D300 HSE DYNAMIC BLACK StationWagon',
'transmission': 'automatic',
'trim': 'D300 HSE DYNAMIC BLACK',
'vin': 'SALWA2AW4NA240572',
'year': 2022}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX22%2520ZVD%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Saving data for WX22%20ZVD: {'auction_closing_time': 1774940400.0, 'created_time': 1773930092.396162, 'last_price_update_time': 1774695999.05296}
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WX22%2520ZVD') HTTP/1.1" 204 0
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea48ed0>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797417%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797417/600 saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:39 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e510c90>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802459%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802459/600 saved to cache
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff62510>
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_expert_report_file_68bb3d8c-9dd8-4f5c-a896-30dc2b154938.pdf HTTP/1.1" 201 0
2026-03-28 11:06:39 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9b95dd9-3469-5e6e-ba6a-02b349aae404, skipping ID generation
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD75EHO-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD75EHO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775725/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: WX73%20YZA
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX73%2520YZA%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for WX73%20YZA: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YK21%20VRC
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK21%2520VRC%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YK21%20VRC: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YL70%20NVC
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL70%2520NVC%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YL70%20NVC: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YN22%20WKM
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN22%2520WKM%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YN22%20WKM: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YN23%20WUP
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN23%2520WUP%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YN23%20WUP: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YR22%20XOF
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR22%2520XOF%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YR22%20XOF: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YR69%20ZVN
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR69%2520ZVN%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YR69%20ZVN: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: AV18%20LLP
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV18%2520LLP%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for AV18%20LLP: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: RO21%20VFW
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO21%2520VFW%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for RO21%20VFW: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: SW69%20SCX
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520SCX%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for SW69%20SCX: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: CP17%20DYG
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP17%2520DYG%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for CP17%20DYG: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: EJ17%20HGU
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ17%2520HGU%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for EJ17%20HGU: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: MT17%20UTS
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT17%2520UTS%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for MT17%20UTS: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: CX65%20XUD
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX65%2520XUD%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for CX65%20XUD: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: LN68%20FBD
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN68%2520FBD%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for LN68%20FBD: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: FV21%20VKU
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV21%2520VKU%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for FV21%20VKU: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: MF22%20KJU
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520KJU%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for MF22%20KJU: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: RJ18%20ZHN
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520ZHN%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for RJ18%20ZHN: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: BT66%20ZFD
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT66%2520ZFD%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for BT66%20ZFD: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: BX20%20FKV
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX20%2520FKV%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for BX20%20FKV: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: MT14%20TZF
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520TZF%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for MT14%20TZF: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: SM70%20ZWE
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM70%2520ZWE%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for SM70%20ZWE: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: DX68%20VZO
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520VZO%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for DX68%20VZO: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: FE20%20HHJ
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE20%2520HHJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for FE20%20HHJ: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: MM18%20HRK
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520HRK%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for MM18%20HRK: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: DU20%20XWW
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520XWW%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for DU20%20XWW: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: GN70%20OTT
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN70%2520OTT%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for GN70%20OTT: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YB19%20EOM
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB19%2520EOM%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YB19%20EOM: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: YG21%20HVH
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG21%2520HVH%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for YG21%20HVH: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: BJ22%20OGX
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ22%2520OGX%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for BJ22%20OGX: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: RA19%20XWL
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA19%2520XWL%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for RA19%20XWL: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: SY19%20CEJ
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520CEJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for SY19%20CEJ: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: DY64%20YTD
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY64%2520YTD%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for DY64%20YTD: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: ML69%20KTJ
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML69%2520KTJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:39 [bca.uk] INFO: Scrape type for ML69%20KTJ: 0
2026-03-28 11:06:39 [bca.uk] INFO: Found listing with ID: NU21%20PFD
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU21%2520PFD%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for NU21%20PFD: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: OV69%20OAL
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520OAL%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for OV69%20OAL: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: OW17%20RHY
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520RHY%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for OW17%20RHY: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: WF68%20WGC
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF68%2520WGC%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for WF68%20WGC: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: YE67%20OPH
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE67%2520OPH%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for YE67%20OPH: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: LL18%20OTM
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL18%2520OTM%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for LL18%20OTM: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: LX16%20CNU
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX16%2520CNU%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for LX16%20CNU: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: OW17%20PUO
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW17%2520PUO%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for OW17%20PUO: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: RK66%20MLE
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK66%2520MLE%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for RK66%20MLE: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: SC19%20RJJ
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC19%2520RJJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for SC19%20RJJ: 0
2026-03-28 11:06:40 [bca.uk] INFO: Found listing with ID: FL24%20MXK
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL24%2520MXK%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [bca.uk] INFO: Scrape type for FL24%20MXK: 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508041%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508041 not downloaded yet
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3c110>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698767015%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767015/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d17d0>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698828028%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828028/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0c090>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797407%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797407/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0e290>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802434%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802434/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775862>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910908/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697910908>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822491>
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822519/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828020/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508050%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508050 not downloaded yet
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0c1d0>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775725%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775725/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf9a90>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797378%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797378/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797377>
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828012/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828012>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802390>
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508059%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508059 not downloaded yet
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d1050>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822519%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822519/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb01590>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698828020%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828020/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb03490>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775899%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775899/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508065%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508065 not downloaded yet
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775717/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775717>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508034/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD75EHO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508076%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508076 not downloaded yet
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8f78d0>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797390%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797390/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e291ad0>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797359%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797359/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa7c50>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802411%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802411/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508041>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775823>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797347/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797347>
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508096%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508096 not downloaded yet
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910908/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF65SSV/42806572?sv=2020-08-04&st=2026-03-28T11%3A06%3A05Z&se=2026-03-28T11%3A31%3A05Z&sr=b&sp=r&sig=1o%2FMjxgp%2FIsHLMd0wCyHkjMpj5rEXVhHg0znW9g9tJ4%3D)
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508115%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508115 not downloaded yet
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508131%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508131 not downloaded yet
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698508153%27 HTTP/1.1" 200 None
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508153 not downloaded yet
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828006/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828006>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508050>
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797362/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797362>
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802365/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802365>
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508034/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4b8710>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775862%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775862/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828012/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775717/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508065/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508065>
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:40 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e510550>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822491%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822491/600 saved to cache
2026-03-28 11:06:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797347/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508076/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508076>
2026-03-28 11:06:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508096/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508096>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e412210>
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF65SSV%252F697910908%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910908/600 saved to cache
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d734e44-52d9-57e4-8863-dc7d94854907
2026-03-28 11:06:41 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d734e44-52d9-57e4-8863-dc7d94854907, skipping ID generation
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d734e44-52d9-57e4-8863-dc7d94854907 sending to next pipeline
2026-03-28 11:06:41 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d734e44-52d9-57e4-8863-dc7d94854907, identifier: PF65%20SSV
2026-03-28 11:06:41 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d734e44-52d9-57e4-8863-dc7d94854907 with identifier: PF65%20SSV
2026-03-28 11:06:41 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d734e44-52d9-57e4-8863-dc7d94854907 with identifier: PF65%20SSV
2026-03-28 11:06:41 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d734e44-52d9-57e4-8863-dc7d94854907 with identifier: PF65%20SSV to the API
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:41 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910908/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_expert_report_file_fe15bd0c-47e4-4656-9d5a-080fe999272e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF65%20SSV-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0d734e44-52d9-57e4-8863-dc7d94854907',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF65 SSV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF65%20SSV&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 85175,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910878/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49111,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43298,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910904/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910908/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910914/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44008,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78612,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910945/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910963/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78838,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910982/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d734e44-52d9-57e4-8863-dc7d94854907/0d734e44-52d9-57e4-8863-dc7d94854907_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73602,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF65SSV/697910997/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 2.0 TD4 180 HSE LUXURY StationWagon',
'transmission': 'automatic',
'trim': 'TD4 180 HSE LUXURY',
'vin': 'SALCA2AN2GH576452',
'year': 2016}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520SSV%27 HTTP/1.1" 200 None
2026-03-28 11:06:41 [bca.uk] INFO: Saving data for PF65%20SSV: {'created_time': 1774696001.767737, 'last_price_update_time': 1774696001.767748, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF65%2520SSV') HTTP/1.1" 204 0
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797362/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508153/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508153>
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828006/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508065/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508115/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508115>
2026-03-28 11:06:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802365/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508131>
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff2bc90>
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802390%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802390/600 saved to cache
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4d7d0>
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797377%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797377/600 saved to cache
2026-03-28 11:06:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4ba210>
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508034%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508034/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4f9d0>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698828012%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828012/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8ec90>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775717%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775717/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e982310>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508041%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508041/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb77650>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797347%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797347/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4ce90>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775823%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775823/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc85c10>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797362%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797362/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb03f50>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508050%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508050/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf5c50>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698828006%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828006/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb00350>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508065%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508065/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5c0550>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802365%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802365/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508076/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822432/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822432>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508059/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698508059>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797337/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797337>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775708/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NG13GKJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766961/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF64ZPZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508096/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775798/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775798>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797351/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797351>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828001/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698828001>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802345/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802345>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813574>
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508115/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766961/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF64ZPZ/42807431?sv=2020-08-04&st=2026-03-28T11%3A06%3A08Z&se=2026-03-28T11%3A31%3A08Z&sr=b&sp=r&sig=zTPMpUxf%2BhngNuzjI%2BQOP8T%2B7FOOQvtjEXE5DDOAryk%3D)
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94aeb28450>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508076%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508076/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508153/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcbfc10>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508096%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508096/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3d0a90>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508131%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508131/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775708/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NG13GKJ/42807759?sv=2020-08-04&st=2026-03-28T11%3A06%3A06Z&se=2026-03-28T11%3A31%3A06Z&sr=b&sp=r&sig=ACq%2Fr6bTkpDm%2BM7YAdHbiyt9OdSqg8%2BN8n1NVGcS7hg%3D)
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797337/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508059/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD75EHO/42801458?sv=2020-08-04&st=2026-03-28T11%3A06%3A32Z&se=2026-03-28T11%3A31%3A32Z&sr=b&sp=r&sig=%2FHxpf8yFaqbKykgLRVa3DDOS6YdRsl98YIswXEtxcaM%3D)
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088439>
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822432/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YP18HSO/42808548?sv=2020-08-04&st=2026-03-28T11%3A06%3A04Z&se=2026-03-28T11%3A31%3A04Z&sr=b&sp=r&sig=9Cmmu9ovSlaapciZ5vpWzdXY%2FhPE8U6%2B3%2FHnZbRjHZM%3D)
2026-03-28 11:06:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797351/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802326>
2026-03-28 11:06:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827997>
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcad6d0>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508115%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508115/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae459390>
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF64ZPZ%252F698766961%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766961/600 saved to cache
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 65008501-d7e3-5111-b4f9-a8e8adb781bc
2026-03-28 11:06:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 65008501-d7e3-5111-b4f9-a8e8adb781bc, skipping ID generation
2026-03-28 11:06:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 65008501-d7e3-5111-b4f9-a8e8adb781bc sending to next pipeline
2026-03-28 11:06:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 65008501-d7e3-5111-b4f9-a8e8adb781bc, identifier: MF64%20ZPZ
2026-03-28 11:06:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 65008501-d7e3-5111-b4f9-a8e8adb781bc with identifier: MF64%20ZPZ
2026-03-28 11:06:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 65008501-d7e3-5111-b4f9-a8e8adb781bc with identifier: MF64%20ZPZ
2026-03-28 11:06:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 65008501-d7e3-5111-b4f9-a8e8adb781bc with identifier: MF64%20ZPZ to the API
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766961/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_expert_report_file_24c02b55-db0b-4514-ab0a-4813992ab63e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF64%20ZPZ-GB',
'category': 'Car',
'color': 'brown',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '65008501-d7e3-5111-b4f9-a8e8adb781bc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF64 ZPZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF64%20ZPZ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 106468,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766961/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49652,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698766975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767002/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45486,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767030/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45208,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767042/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87710,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767070/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71263,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767087/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767101/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_65008501-d7e3-5111-b4f9-a8e8adb781bc/65008501-d7e3-5111-b4f9-a8e8adb781bc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF64ZPZ/698767118/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 125 TITANIUM X Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM X',
'vin': 'WF0DXXGAKDEB77759',
'year': 2014}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF64%2520ZPZ%27 HTTP/1.1" 200 None
2026-03-28 11:06:43 [bca.uk] INFO: Saving data for MF64%20ZPZ: {'created_time': 1774696003.342627, 'last_price_update_time': 1774696003.342637, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF64%2520ZPZ') HTTP/1.1" 204 0
2026-03-28 11:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797339>
2026-03-28 11:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813551/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813551>
2026-03-28 11:06:43 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088431/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088431>
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828001/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775798/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802345/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:43 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:43 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:43 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:43 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:43 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac535c10>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508153%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508153/600 saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2cf2d0>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNG13GKJ%252F698775708%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775708/600 saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3
2026-03-28 11:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3, skipping ID generation
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3 sending to next pipeline
2026-03-28 11:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3, identifier: NG13%20GKJ
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e6c50>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797337%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797337/600 saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebd6090>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD75EHO%252F698508059%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508059/600 saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c9b95dd9-3469-5e6e-ba6a-02b349aae404
2026-03-28 11:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c9b95dd9-3469-5e6e-ba6a-02b349aae404, skipping ID generation
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c9b95dd9-3469-5e6e-ba6a-02b349aae404 sending to next pipeline
2026-03-28 11:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9b95dd9-3469-5e6e-ba6a-02b349aae404, identifier: LD75%20EHO
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe55f10>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYP18HSO%252F698822432%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822432/600 saved to cache
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item d5f11c4c-dabf-588c-a1de-3167e7ec7290
2026-03-28 11:06:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: d5f11c4c-dabf-588c-a1de-3167e7ec7290, skipping ID generation
2026-03-28 11:06:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item d5f11c4c-dabf-588c-a1de-3167e7ec7290 sending to next pipeline
2026-03-28 11:06:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d5f11c4c-dabf-588c-a1de-3167e7ec7290, identifier: YP18%20HSO
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebd4c90>
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797351%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797351/600 saved to cache
2026-03-28 11:06:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797303/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=VA19XRY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802310>
2026-03-28 11:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813520/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813520>
2026-03-28 11:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797326>
2026-03-28 11:06:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088419>
2026-03-28 11:06:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3 with identifier: NG13%20GKJ
2026-03-28 11:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3 with identifier: NG13%20GKJ
2026-03-28 11:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3 with identifier: NG13%20GKJ to the API
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775708/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_expert_report_file_2b65c788-dca3-4dbe-a88f-5b8180a9bdcd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NG13%20GKJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NG13 GKJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NG13%20GKJ&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'AUDI',
'model': 'A3 SPORTBACK',
'odometer': 110676,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48391,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775708/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775717/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43618,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775719/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43491,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775725/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775765/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775800/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775843/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3/fcfcb124-8dbb-5693-bf0c-4bfa31aaf0a3_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NG13GKJ/698775887/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'AUDI A3 SPORTBACK 1.4 TFSI 122 SPORT Hatchback',
'transmission': 'manual',
'trim': 'TFSI 122 SPORT',
'vin': 'WAUZZZ8V3EA019724',
'year': 2013}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG13%2520GKJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [bca.uk] INFO: Saving data for NG13%20GKJ: {'created_time': 1774696004.414786, 'last_price_update_time': 1774696004.414797, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NG13%2520GKJ') HTTP/1.1" 204 0
2026-03-28 11:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9b95dd9-3469-5e6e-ba6a-02b349aae404 with identifier: LD75%20EHO
2026-03-28 11:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9b95dd9-3469-5e6e-ba6a-02b349aae404 with identifier: LD75%20EHO
2026-03-28 11:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9b95dd9-3469-5e6e-ba6a-02b349aae404 with identifier: LD75%20EHO to the API
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508059/600>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_expert_report_file_68bb3d8c-9dd8-4f5c-a896-30dc2b154938.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD75%20EHO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Electric',
'id': 'c9b95dd9-3469-5e6e-ba6a-02b349aae404',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD75 EHO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD75%20EHO&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'TESLA',
'model': 'MODEL Y',
'odometer': 4826,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45202,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508034/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44854,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45335,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508059/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42247,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508065/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43020,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508076/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508096/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508115/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82910,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c9b95dd9-3469-5e6e-ba6a-02b349aae404/c9b95dd9-3469-5e6e-ba6a-02b349aae404_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD75EHO/698508153/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'TESLA MODEL Y RWD LONG RANGE Hatchback',
'transmission': 'automatic',
'trim': 'RWD LONG RANGE',
'vin': 'XP7YHCER1SB724397',
'year': 2025}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD75%2520EHO%27 HTTP/1.1" 200 None
2026-03-28 11:06:44 [bca.uk] INFO: Saving data for LD75%20EHO: {'created_time': 1774696004.79768, 'last_price_update_time': 1774696004.797689, 'auction_closing_time': 1775124000.0}
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD75%2520EHO') HTTP/1.1" 204 0
2026-03-28 11:06:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO
2026-03-28 11:06:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO
2026-03-28 11:06:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d5f11c4c-dabf-588c-a1de-3167e7ec7290 with identifier: YP18%20HSO to the API
2026-03-28 11:06:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822432/600>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_expert_report_file_381d29fa-930f-4855-894a-e6a62f8844a0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YP18%20HSO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd5f11c4c-dabf-588c-a1de-3167e7ec7290',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YP18 HSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YP18%20HSO&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 48634,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46807,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822371/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44644,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822389/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43455,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43893,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822432/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81904,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822519/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77908,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_d5f11c4c-dabf-588c-a1de-3167e7ec7290/d5f11c4c-dabf-588c-a1de-3167e7ec7290_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79207,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YP18HSO/698822574/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 MPI 75 HIGH UP Hatchback',
'transmission': 'manual',
'trim': 'MPI 75 HIGH UP',
'vin': 'WVWZZZAAZJD169127',
'year': 2018}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP18%2520HSO%27 HTTP/1.1" 200 None
2026-03-28 11:06:45 [bca.uk] INFO: Saving data for YP18%20HSO: {'created_time': 1774696005.206371, 'last_price_update_time': 1774696005.206385, 'auction_closing_time': 1774864800.0}
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YP18%2520HSO') HTTP/1.1" 204 0
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae46fc90>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698828001%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828001/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff28290>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698827997%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827997/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea4ba50>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775798%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775798/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff2bdd0>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802345%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802345/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2c990>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813574%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813574/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088431/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698797313>
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775753/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775753>
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827978/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698827978>
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802289/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802289>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf4350>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802326%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802326/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813551/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813482/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813482>
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf79d0>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088439%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088439/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eab8050>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088431%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088431/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2c550>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797339%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797339/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797303/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VA19XRY/42808075?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=bvwqNFShAI6aSO0HBVGMIyKqkBW3NT41bJp0tAVz7BA%3D)
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088413>
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775737/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PL68ZCX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813520/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3e1d0>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813551%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813551/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802289/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SD14UCC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775753/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827978/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802269/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PK14VAX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813482/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac411c50>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802310%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802310/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775737/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PL68ZCX/42807555?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=BSgxLxwJEeVcjSL35w5jndCZsrg8BZjGoLsFXU3fdqY%3D)
2026-03-28 11:06:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827975/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FH18LKJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc8090>
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVA19XRY%252F698797303%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797303/600 saved to cache
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15
2026-03-28 11:06:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15, skipping ID generation
2026-03-28 11:06:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 sending to next pipeline
2026-03-28 11:06:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15, identifier: VA19%20XRY
2026-03-28 11:06:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY
2026-03-28 11:06:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY
2026-03-28 11:06:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20daa90f-0a84-5a6d-ba71-f0ccc13c1d15 with identifier: VA19%20XRY to the API
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797303/600>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_expert_report_file_a879bfe9-1f73-4a87-aef5-7a6099c5e587.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VA19%20XRY-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '20daa90f-0a84-5a6d-ba71-f0ccc13c1d15',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VA19 XRY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VA19%20XRY&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'TIGUAN',
'odometer': 93314,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797303/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47186,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797314/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797325/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43538,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797337/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43029,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797347/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42862,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20daa90f-0a84-5a6d-ba71-f0ccc13c1d15/20daa90f-0a84-5a6d-ba71-f0ccc13c1d15_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VA19XRY/698797427/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN TIGUAN 2.0 TDI 150 BMT 2WD SEL DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 150 BMT 2WD SEL DSG',
'vin': 'WVGZZZ5NZKW382748',
'year': 2019}
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520XRY%27 HTTP/1.1" 200 None
2026-03-28 11:06:46 [bca.uk] INFO: Saving data for VA19%20XRY: {'created_time': 1774696006.395343, 'last_price_update_time': 1774696006.395356, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VA19%2520XRY') HTTP/1.1" 204 0
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088405/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=694088405>
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813439/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698813439>
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK64%20WXM-GB>
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ16%20YOR-GB>
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KO17XBK-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3c2d0>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797326%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797326/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe86590>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813520%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813520/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff3dc10>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088419%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088419/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP70%20XEN-GB>
2026-03-28 11:06:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147572>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e423a10>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802289%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802289/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e861c10>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797313%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797313/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae77fb50>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775753%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775753/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcb1790>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698827978%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827978/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bc810>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813482%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813482/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac0ec510>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPL68ZCX%252F698775737%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775737/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e
2026-03-28 11:06:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 2c5f13b8-4d4a-53db-9b96-4c70590a110e, skipping ID generation
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 2c5f13b8-4d4a-53db-9b96-4c70590a110e sending to next pipeline
2026-03-28 11:06:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2c5f13b8-4d4a-53db-9b96-4c70590a110e, identifier: PL68%20ZCX
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:46 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3ca7d0>
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088413%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088413/600 saved to cache
2026-03-28 11:06:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX
2026-03-28 11:06:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX
2026-03-28 11:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2c5f13b8-4d4a-53db-9b96-4c70590a110e with identifier: PL68%20ZCX to the API
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775737/600>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_expert_report_file_2cac820e-8849-4404-be6f-d70e390508f4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PL68%20ZCX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2c5f13b8-4d4a-53db-9b96-4c70590a110e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PL68 ZCX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PL68%20ZCX&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'POLO',
'odometer': 46828,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775737/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47541,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775753/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41251,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775764/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42557,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775798/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41795,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96977,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775862/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92052,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_2c5f13b8-4d4a-53db-9b96-4c70590a110e/2c5f13b8-4d4a-53db-9b96-4c70590a110e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PL68ZCX/698775957/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN POLO 1.0 TSI 115 R LINE Hatchback',
'transmission': 'manual',
'trim': 'TSI 115 R LINE',
'vin': 'WVWZZZAWZKU036819',
'year': 2019}
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL68%2520ZCX%27 HTTP/1.1" 200 None
2026-03-28 11:06:47 [bca.uk] INFO: Saving data for PL68%20ZCX: {'created_time': 1774696007.300985, 'last_price_update_time': 1774696007.301, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PL68%2520ZCX') HTTP/1.1" 204 0
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802269/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PK14VAX/42808180?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=EPVrf4lJsehdZUnOvl%2FU7v07eUhHivttOeL7LngIaRs%3D)
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827975/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FH18LKJ/42808566?sv=2020-08-04&st=2026-03-28T11%3A06%3A03Z&se=2026-03-28T11%3A31%3A03Z&sr=b&sp=r&sig=cczMZdmTHaKqzvGe3UP9Xbu152P2Iw47Gy%2BT5bje5Tg%3D)
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD14UCC/42807952?sv=2020-08-04&st=2026-03-28T11%3A06%3A02Z&se=2026-03-28T11%3A31%3A02Z&sr=b&sp=r&sig=Jku2q1rjdxaIz%2FCpJGjSOxCjNPOmI0j4qlKldYji8Ew%3D)
2026-03-28 11:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822546/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822546>
2026-03-28 11:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL67%20NGU-GB>
2026-03-28 11:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818401>
2026-03-28 11:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147549/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147549>
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:47 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240951/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240951>
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813439/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SD60OBV/42808330?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=AJmNgjY0mR%2FK4Ov6GRzjfP2o87bxL%2FVmxpwvz74h9mQ%3D)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc3590>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPK14VAX%252F698802269%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802269/600 saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item bb25d155-3621-58d2-8d7a-91adc9b51d32
2026-03-28 11:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: bb25d155-3621-58d2-8d7a-91adc9b51d32, skipping ID generation
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item bb25d155-3621-58d2-8d7a-91adc9b51d32 sending to next pipeline
2026-03-28 11:06:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bb25d155-3621-58d2-8d7a-91adc9b51d32, identifier: PK14%20VAX
2026-03-28 11:06:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX
2026-03-28 11:06:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX
2026-03-28 11:06:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bb25d155-3621-58d2-8d7a-91adc9b51d32 with identifier: PK14%20VAX to the API
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802269/600>
{'auction_title': '',
'c_o_2_emission_value': 105,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_expert_report_file_462a1f11-6fd1-4f6d-8b8a-deec6ca7d8a7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PK14%20VAX-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bb25d155-3621-58d2-8d7a-91adc9b51d32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PK14 VAX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PK14%20VAX&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'UP!',
'odometer': 91449,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47842,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802269/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802289/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42877,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41080,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802345/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41896,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802365/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87810,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60350,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802434/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_bb25d155-3621-58d2-8d7a-91adc9b51d32/bb25d155-3621-58d2-8d7a-91adc9b51d32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PK14VAX/698802459/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN UP! 1.0 60 MOVE UP Hatchback',
'transmission': 'manual',
'trim': '60 MOVE UP',
'vin': 'WVWZZZAAZED109160',
'year': 2014}
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK14%2520VAX%27 HTTP/1.1" 200 None
2026-03-28 11:06:47 [bca.uk] INFO: Saving data for PK14%20VAX: {'created_time': 1774696007.9239, 'last_price_update_time': 1774696007.923916, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PK14%2520VAX') HTTP/1.1" 204 0
2026-03-28 11:06:47 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088405/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KO17XBK/42715248?sv=2020-08-04&st=2026-03-28T11%3A06%3A00Z&se=2026-03-28T11%3A31%3A00Z&sr=b&sp=r&sig=Ob50kn5fZ9IA2V3s5D6HdhkEYn6vXcBQysgcP9s%2FZyU%3D)
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e981fd0>
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFH18LKJ%252F698827975%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827975/600 saved to cache
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 01d1abad-b65f-5ff3-9afb-406711acef32
2026-03-28 11:06:47 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 01d1abad-b65f-5ff3-9afb-406711acef32, skipping ID generation
2026-03-28 11:06:47 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 01d1abad-b65f-5ff3-9afb-406711acef32 sending to next pipeline
2026-03-28 11:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 01d1abad-b65f-5ff3-9afb-406711acef32, identifier: FH18%20LKJ
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9abb50>
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD14UCC%252F698797300%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797300/600 saved to cache
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2
2026-03-28 11:06:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2, skipping ID generation
2026-03-28 11:06:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 sending to next pipeline
2026-03-28 11:06:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2, identifier: SD14%20UCC
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147549/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ
2026-03-28 11:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ
2026-03-28 11:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 01d1abad-b65f-5ff3-9afb-406711acef32 with identifier: FH18%20LKJ to the API
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827975/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_expert_report_file_dc6b3bed-36b9-4c8c-bad0-58cf8fe78852.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FH18%20LKJ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '01d1abad-b65f-5ff3-9afb-406711acef32',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FH18 LKJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FH18%20LKJ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'LAND ROVER',
'model': 'R/R VELAR',
'odometer': 48290,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48285,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827975/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45908,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827978/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827989/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698827997/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828006/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81074,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828012/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82320,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828020/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828028/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_01d1abad-b65f-5ff3-9afb-406711acef32/01d1abad-b65f-5ff3-9afb-406711acef32_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FH18LKJ/698828037/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R VELAR 2.0 D240 R-DYNAMIC S StationWagon',
'transmission': 'automatic',
'trim': 'D240 R-DYNAMIC S',
'vin': 'SALYA2AN3JA760580',
'year': 2018}
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH18%2520LKJ%27 HTTP/1.1" 200 None
2026-03-28 11:06:48 [bca.uk] INFO: Saving data for FH18%20LKJ: {'created_time': 1774696008.628066, 'last_price_update_time': 1774696008.628077, 'auction_closing_time': 1774778400.0}
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FH18%2520LKJ') HTTP/1.1" 204 0
2026-03-28 11:06:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC
2026-03-28 11:06:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC
2026-03-28 11:06:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 166e720d-02de-5f8c-8f19-1a2cd23f9ef2 with identifier: SD14%20UCC to the API
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797300/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_expert_report_file_cd33ebac-6791-4e90-86a6-49d40d1187c2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD14%20UCC-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '166e720d-02de-5f8c-8f19-1a2cd23f9ef2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD14 UCC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD14%20UCC&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 76415,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48050,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43630,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43836,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797351/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797362/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84343,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48227,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81601,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797407/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_166e720d-02de-5f8c-8f19-1a2cd23f9ef2/166e720d-02de-5f8c-8f19-1a2cd23f9ef2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75453,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD14UCC/698797417/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 16V SE Hatchback',
'transmission': 'automatic',
'trim': '16V SE',
'vin': 'W0L0SDL08E6049555',
'year': 2014}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD14%2520UCC%27 HTTP/1.1" 200 None
2026-03-28 11:06:49 [bca.uk] INFO: Saving data for SD14%20UCC: {'created_time': 1774696009.050863, 'last_price_update_time': 1774696009.050874, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD14%2520UCC') HTTP/1.1" 204 0
2026-03-28 11:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e863090>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088382%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088382/600 saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffcc990>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSD60OBV%252F698813439%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813439/600 saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item fca0f45a-4408-54bd-8e77-e17744d1d730
2026-03-28 11:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: fca0f45a-4408-54bd-8e77-e17744d1d730, skipping ID generation
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item fca0f45a-4408-54bd-8e77-e17744d1d730 sending to next pipeline
2026-03-28 11:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fca0f45a-4408-54bd-8e77-e17744d1d730, identifier: SD60%20OBV
2026-03-28 11:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV
2026-03-28 11:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV
2026-03-28 11:06:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fca0f45a-4408-54bd-8e77-e17744d1d730 with identifier: SD60%20OBV to the API
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813439/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_expert_report_file_bcb297de-f80e-4ca6-b455-18838a675dd1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SD60%20OBV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fca0f45a-4408-54bd-8e77-e17744d1d730',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SD60 OBV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SD60%20OBV&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 87594,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43605,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42955,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40900,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41548,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813410/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813424/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39242,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813439/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98843,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 54809,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813520/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84675,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813551/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_fca0f45a-4408-54bd-8e77-e17744d1d730/fca0f45a-4408-54bd-8e77-e17744d1d730_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81275,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SD60OBV/698813574/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 16V EXTREME Hatchback',
'transmission': 'manual',
'trim': '16V EXTREME',
'vin': 'VF1CR1J0H44178671',
'year': 2010}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD60%2520OBV%27 HTTP/1.1" 200 None
2026-03-28 11:06:49 [bca.uk] INFO: Saving data for SD60%20OBV: {'created_time': 1774696009.669559, 'last_price_update_time': 1774696009.66957, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SD60%2520OBV') HTTP/1.1" 204 0
2026-03-28 11:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822546/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818377/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818377>
2026-03-28 11:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY68%20NKD-GB>
2026-03-28 11:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302489>
2026-03-28 11:06:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794280>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae97e8d0>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKO17XBK%252F694088405%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088405/600 saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b
2026-03-28 11:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8ce90445-cafa-5c75-bbfc-7c7467058c9b, skipping ID generation
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8ce90445-cafa-5c75-bbfc-7c7467058c9b sending to next pipeline
2026-03-28 11:06:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8ce90445-cafa-5c75-bbfc-7c7467058c9b, identifier: KO17%20XBK
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8f350>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147549%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147549/600 saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac13d890>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818401%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818401/600 saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:49 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e861e90>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147572%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147572/600 saved to cache
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0f9d0>
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_expert_report_file_7bec89ac-68dd-44ab-9d9e-3fce75498b7c.pdf HTTP/1.1" 201 0
2026-03-28 11:06:49 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09367c6e-3396-5657-95ea-a9c92174c186, skipping ID generation
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFP70XEN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP70XEN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK
2026-03-28 11:06:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK
2026-03-28 11:06:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8ce90445-cafa-5c75-bbfc-7c7467058c9b with identifier: KO17%20XBK to the API
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088405/600>
{'auction_title': '',
'c_o_2_emission_value': 124,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_expert_report_file_eb0674a4-af22-4e00-b9cf-86c1822c2e2a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KO17%20XBK-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8ce90445-cafa-5c75-bbfc-7c7467058c9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KO17 XBK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KO17%20XBK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 83059,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49054,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47731,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46196,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48766,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088396/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46138,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088405/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66579,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69690,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83338,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088431/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8ce90445-cafa-5c75-bbfc-7c7467058c9b/8ce90445-cafa-5c75-bbfc-7c7467058c9b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66747,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KO17XBK/694088439/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 2.0 BLUEHDI 180 GT EAT6 Hatchback',
'transmission': 'automatic',
'trim': 'BLUEHDI 180 GT EAT6',
'vin': 'VF3MJAHWWHS011750',
'year': 2017}
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO17%2520XBK%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [bca.uk] INFO: Saving data for KO17%20XBK: {'created_time': 1774696010.336579, 'last_price_update_time': 1774696010.336594, 'auction_closing_time': 1774864800.0}
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KO17%2520XBK') HTTP/1.1" 204 0
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822526/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822526>
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787041%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787041 not downloaded yet
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcbd810>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_expert_report_file_b9810cc7-edd1-4335-add3-dbcb7b27247c.pdf HTTP/1.1" 201 0
2026-03-28 11:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 968e893f-f12d-5bf3-9181-e47269b48833, skipping ID generation
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBK64WXM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK64WXM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e89a450>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_expert_report_file_2696f701-9075-495b-81b8-3830af7599e0.pdf HTTP/1.1" 201 0
2026-03-28 11:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f0a65b2-f444-59d5-a5b9-263002d87b3b, skipping ID generation
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFJ16YOR-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FJ16YOR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302485/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302485>
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240949>
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822505/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822505>
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818343/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818343>
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147533>
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY69%20LZL-GB>
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240951/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787062%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787062 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775732%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775732 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802270%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802270 not downloaded yet
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e39d0>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_expert_report_file_43dca273-c54d-4cca-b39c-060c6528b9c9.pdf HTTP/1.1" 201 0
2026-03-28 11:06:50 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1, skipping ID generation
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DYL67NGU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YL67NGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8f6950>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822546%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822546/600 saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147516>
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787072%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787072 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775740%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775740 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802288%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802288 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802561%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802561 not downloaded yet
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:50 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb18210>
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240951%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240951/600 saved to cache
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296423>
2026-03-28 11:06:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240946/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240946>
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787090%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787090 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775757%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775757 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802304%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802304 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802584%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802584 not downloaded yet
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818377/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822526/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787105%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787105 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775774%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775774 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802321%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802321 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802608%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802608 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787126%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787126 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775792%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775792 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802335%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802335 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802632%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802632 not downloaded yet
2026-03-28 11:06:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787149%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787149 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775833%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775833 not downloaded yet
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802360%27 HTTP/1.1" 200 None
2026-03-28 11:06:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802360 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802656%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802656 not downloaded yet
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302485/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa5010>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818377%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818377/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e876d90>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822526%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822526/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3d450>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794280%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794280/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2d890>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302489%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302489/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FJ16YOR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822505/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787176%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787176 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775876%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775876 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802383%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802383 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802685%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802685 not downloaded yet
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818343/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac412290>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_expert_report_file_613d7ea9-4ff2-48fa-b709-001cde516e03.pdf HTTP/1.1" 201 0
2026-03-28 11:06:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed0d6e28-3650-545d-831e-d2a8e2e62449, skipping ID generation
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEY68NKD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EY68NKD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802584>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787222%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787222 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775911%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775911 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802401%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802401 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802710%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802710 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647782%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647782 not downloaded yet
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802632/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802632>
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802304>
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240946/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787090>
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775757/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775757>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775947%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775947 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802424%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802424 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802734%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802734 not downloaded yet
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac351f10>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_expert_report_file_42e903e8-e405-4c39-b8ea-646fe0e1a2e1.pdf HTTP/1.1" 201 0
2026-03-28 11:06:51 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75e6d52b-e0f5-58e1-add5-dd491e4ef466, skipping ID generation
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGY69LZL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GY69LZL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc87550>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147533%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147533/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9fc10>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302485%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302485/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae46a4d0>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822505%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822505/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9e390>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147516%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147516/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802608/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802608>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647803%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647803 not downloaded yet
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802335/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802335>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698802749%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802749 not downloaded yet
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661550%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661550 not downloaded yet
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc52f10>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818343%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818343/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac242d10>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240949%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240949/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647816%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647816 not downloaded yet
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802360/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802360>
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775792/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775792>
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775833/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775833>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661562%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661562 not downloaded yet
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787149/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787149>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647826%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647826 not downloaded yet
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdb1fd0>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296423%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296423/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:51 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8eba50>
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240946%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240946/600 saved to cache
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:51 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802656>
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661569%27 HTTP/1.1" 200 None
2026-03-28 11:06:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661569 not downloaded yet
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775757/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647830%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647830 not downloaded yet
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661578%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661578 not downloaded yet
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a9950>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802257%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802257/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647845%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647845 not downloaded yet
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802335/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802710/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802710>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802401/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802401>
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661589%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661589 not downloaded yet
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647860%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647860 not downloaded yet
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787149/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661605%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661605 not downloaded yet
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802608/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647877%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647877 not downloaded yet
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea63b50>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802584%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802584/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e299750>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775757%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775757/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802632/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661622%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661622 not downloaded yet
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775792/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647816/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647816>
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698647904%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647904 not downloaded yet
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775833/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802360/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661635%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661635 not downloaded yet
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647826/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647826>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661562/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661562>
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698661648%27 HTTP/1.1" 200 None
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661648 not downloaded yet
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb03610>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802304%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802304/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac474a10>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802335%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802335/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e28a7d0>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787090%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787090/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e3a50>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787149%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787149/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e412c90>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802608%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802608/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647830/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647830>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661578/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661578>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647860/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647860>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661569/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661569>
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802401/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802710/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac474310>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802632%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802632/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac240b10>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775792%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775792/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac411310>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802656%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802656/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3c210>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775833%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775833/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e874e10>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802360%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802360/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661562/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647816/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661589/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661589>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661622/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661622>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647845/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647845>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661550>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661605/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661605>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647877/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647877>
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e611050>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802401%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802401/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:52 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fcb10>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802710%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802710/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3c83d0>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661562%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661562/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdfb6d0>
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:52 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647816%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647816/600 saved to cache
2026-03-28 11:06:52 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661648>
2026-03-28 11:06:52 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661635/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698661635>
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647830/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647877/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661578/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647860/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661569/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661622/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661589/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647904/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647904>
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661605/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647826/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffcff90>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647830%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647830/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949feca8d0>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647877%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647877/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802749>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647803/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647803>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802734/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802734>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GY69LZL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4c250>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661578%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661578/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcbc110>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647860%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647860/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661635/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647845/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802424/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802424>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac483f50>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661569%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661569/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc8b110>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661622%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661622/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea89f10>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661589%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661589/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb59890>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661605%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661605/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1c650>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661550%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661550/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647782/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698647782>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775947/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775947>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775911/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775911>
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647904/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e874d10>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647826%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647826/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2f1c50>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661635%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661635/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e513e10>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647845%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647845/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a8e90>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661648%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661648/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY69LZL/42805594?sv=2020-08-04&st=2026-03-28T11%3A06%3A50Z&se=2026-03-28T11%3A31%3A50Z&sr=b&sp=r&sig=gHDpo76P2tMLHAniE%2B0CCYlRE0gIV434mgEjXAs8yXU%3D)
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EY68NKD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787222/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787222>
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802685/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802685>
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a87d0>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647904%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647904/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802424/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775911/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802383/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802383>
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647803/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787176>
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802734/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775876>
2026-03-28 11:06:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaeb490>
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY69LZL%252F698661542%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661542/600 saved to cache
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466
2026-03-28 11:06:53 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75e6d52b-e0f5-58e1-add5-dd491e4ef466, skipping ID generation
2026-03-28 11:06:53 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75e6d52b-e0f5-58e1-add5-dd491e4ef466 sending to next pipeline
2026-03-28 11:06:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75e6d52b-e0f5-58e1-add5-dd491e4ef466, identifier: GY69%20LZL
2026-03-28 11:06:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL
2026-03-28 11:06:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL
2026-03-28 11:06:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75e6d52b-e0f5-58e1-add5-dd491e4ef466 with identifier: GY69%20LZL to the API
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661542/600>
{'auction_title': '',
'c_o_2_emission_value': 144,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_expert_report_file_42e903e8-e405-4c39-b8ea-646fe0e1a2e1.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY69%20LZL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75e6d52b-e0f5-58e1-add5-dd491e4ef466',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY69 LZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY69%20LZL&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'GLA 180',
'odometer': 43678,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46253,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43071,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661562/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661569/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661578/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661589/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72992,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661605/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661622/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85694,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661635/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75e6d52b-e0f5-58e1-add5-dd491e4ef466/75e6d52b-e0f5-58e1-add5-dd491e4ef466_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY69LZL/698661648/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ GLA 180 1.6 URBAN ED.DCT StationWagon',
'transmission': 'automatic',
'trim': 'URBAN ED.DCT',
'vin': 'WDC1569422J686791',
'year': 2019}
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY69%2520LZL%27 HTTP/1.1" 200 None
2026-03-28 11:06:54 [bca.uk] INFO: Saving data for GY69%20LZL: {'created_time': 1774696014.703655, 'last_price_update_time': 1774696014.703666, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY69%2520LZL') HTTP/1.1" 204 0
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787222/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787126/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787126>
2026-03-28 11:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802321>
2026-03-28 11:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775774/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775774>
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647782/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EY68NKD/42805434?sv=2020-08-04&st=2026-03-28T11%3A06%3A49Z&se=2026-03-28T11%3A31%3A49Z&sr=b&sp=r&sig=h1tgxVL2dV%2BGIwa2Xq%2FTXe6jA0fMe8N2u%2BVHqiaeJ2g%3D)
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775947/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802685/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e5290>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802424%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802424/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2b2d0>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775911%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775911/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5c3c50>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647803%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647803/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe98610>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802734%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802734/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd29890>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802749%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802749/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787105/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787105>
2026-03-28 11:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802288/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802288>
2026-03-28 11:06:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802561/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802561>
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802383/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebedc50>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647774%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647774/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bcd90>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787222%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787222/600 saved to cache
2026-03-28 11:06:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e420890>
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEY68NKD%252F698647782%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647782/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ed0d6e28-3650-545d-831e-d2a8e2e62449
2026-03-28 11:06:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ed0d6e28-3650-545d-831e-d2a8e2e62449, skipping ID generation
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ed0d6e28-3650-545d-831e-d2a8e2e62449 sending to next pipeline
2026-03-28 11:06:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ed0d6e28-3650-545d-831e-d2a8e2e62449, identifier: EY68%20NKD
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc3b50>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775947%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775947/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3f950>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802685%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802685/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD
2026-03-28 11:06:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD
2026-03-28 11:06:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ed0d6e28-3650-545d-831e-d2a8e2e62449 with identifier: EY68%20NKD to the API
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647782/600>
{'auction_title': '',
'c_o_2_emission_value': 134,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_expert_report_file_613d7ea9-4ff2-48fa-b709-001cde516e03.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EY68%20NKD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ed0d6e28-3650-545d-831e-d2a8e2e62449',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EY68 NKD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EY68%20NKD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MINI',
'model': 'COUNTRYMAN',
'odometer': 79605,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45344,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647782/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647803/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42451,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647816/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42252,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647826/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98481,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647845/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647860/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647877/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ed0d6e28-3650-545d-831e-d2a8e2e62449/ed0d6e28-3650-545d-831e-d2a8e2e62449_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 110322,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EY68NKD/698647904/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MINI COUNTRYMAN 1.5 COOPER (7) Hatchback',
'transmission': 'automatic',
'trim': 'COOPER (7)',
'vin': 'WMWYW320003F55996',
'year': 2018}
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY68%2520NKD%27 HTTP/1.1" 200 None
2026-03-28 11:06:55 [bca.uk] INFO: Saving data for EY68%20NKD: {'created_time': 1774696015.586755, 'last_price_update_time': 1774696015.586767, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EY68%2520NKD') HTTP/1.1" 204 0
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775774/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775740/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775740>
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787072/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787072>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775732/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775732>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802270>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YL67NGU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787126/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fccaf10>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775876%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775876/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd28bd0>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802383%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802383/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2349d0>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787176%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787176/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e234610>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775774%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775774/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae787fd0>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802321%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802321/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802561/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8f7ad0>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787126%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787126/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775740/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802288/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787062/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787062>
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787105/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787041>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787027/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FP70XEN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775727/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK64WXM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb6a950>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802561%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802561/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YL67NGU/42807512?sv=2020-08-04&st=2026-03-28T11%3A06%3A46Z&se=2026-03-28T11%3A31%3A46Z&sr=b&sp=r&sig=0vqeyhZ6hbwaZkQZNHAj%2BVB0WSDyBbY4zUuVdJLyolE%3D)
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775732/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FJ16YOR/42808110?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=DH0qcDQSFQ4sB%2BuMEjMnz7QnOB42t1LKTC6EGl6MDf4%3D)
2026-03-28 11:06:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787072/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302478/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302478>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR18%20TNX-GB>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794258/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794258>
2026-03-28 11:06:55 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818321/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818321>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f5f90>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775740%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775740/600 saved to cache
2026-03-28 11:06:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e874610>
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802288%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802288/600 saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787027/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296408/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296408>
2026-03-28 11:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147491/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147491>
2026-03-28 11:06:56 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822489>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94bbc15550>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787105%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787105/600 saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:56 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787062/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9b390>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYL67NGU%252F698802540%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802540/600 saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1
2026-03-28 11:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1, skipping ID generation
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 sending to next pipeline
2026-03-28 11:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1, identifier: YL67%20NGU
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fd5d0>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775732%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775732/600 saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e238a50>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFJ16YOR%252F698802270%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802270/600 saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b
2026-03-28 11:06:56 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6f0a65b2-f444-59d5-a5b9-263002d87b3b, skipping ID generation
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6f0a65b2-f444-59d5-a5b9-263002d87b3b sending to next pipeline
2026-03-28 11:06:56 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6f0a65b2-f444-59d5-a5b9-263002d87b3b, identifier: FJ16%20YOR
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5c2490>
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:56 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787072%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787072/600 saved to cache
2026-03-28 11:06:56 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU
2026-03-28 11:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU
2026-03-28 11:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 33c36545-ca6a-57a3-92cb-9ffd71b31ca1 with identifier: YL67%20NGU to the API
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:56 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802540/600>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_expert_report_file_43dca273-c54d-4cca-b39c-060c6528b9c9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YL67%20NGU-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '33c36545-ca6a-57a3-92cb-9ffd71b31ca1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YL67 NGU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YL67%20NGU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'ATECA',
'odometer': 88652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802561/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44623,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802608/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43846,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802632/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802685/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66702,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802710/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71079,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802734/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_33c36545-ca6a-57a3-92cb-9ffd71b31ca1/33c36545-ca6a-57a3-92cb-9ffd71b31ca1_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85474,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YL67NGU/698802749/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'SEAT ATECA 2.0 TDI 190 4D XCELLENCE DSG StationWagon',
'transmission': 'automatic',
'trim': 'TDI 190 4D XCELLENCE DSG',
'vin': 'VSSZZZ5FZH6532356',
'year': 2017}
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL67%2520NGU%27 HTTP/1.1" 200 None
2026-03-28 11:06:56 [bca.uk] INFO: Saving data for YL67%20NGU: {'created_time': 1774696016.840914, 'last_price_update_time': 1774696016.840925, 'auction_closing_time': 1774864800.0}
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YL67%2520NGU') HTTP/1.1" 204 0
2026-03-28 11:06:56 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6f0a65b2-f444-59d5-a5b9-263002d87b3b with identifier: FJ16%20YOR
2026-03-28 11:06:56 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6f0a65b2-f444-59d5-a5b9-263002d87b3b with identifier: FJ16%20YOR
2026-03-28 11:06:56 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6f0a65b2-f444-59d5-a5b9-263002d87b3b with identifier: FJ16%20YOR to the API
2026-03-28 11:06:56 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802270/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_expert_report_file_2696f701-9075-495b-81b8-3830af7599e0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FJ16%20YOR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6f0a65b2-f444-59d5-a5b9-263002d87b3b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FJ16 YOR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FJ16%20YOR&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 128047,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48917,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42509,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802288/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42213,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40940,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43507,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802335/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802360/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86816,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802383/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6f0a65b2-f444-59d5-a5b9-263002d87b3b/6f0a65b2-f444-59d5-a5b9-263002d87b3b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FJ16YOR/698802424/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 184 GTD Hatchback',
'transmission': 'manual',
'trim': 'TDI 184 GTD',
'vin': 'WVWZZZAUZGW233190',
'year': 2016}
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ16%2520YOR%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [bca.uk] INFO: Saving data for FJ16%20YOR: {'created_time': 1774696017.238004, 'last_price_update_time': 1774696017.238016, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FJ16%2520YOR') HTTP/1.1" 204 0
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775727/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK64WXM/42807519?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=NEcwes%2FGj1BwtfLlfaRGqyWeNNHnjcFJPJ%2FpOjr3NY4%3D)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FP70XEN/42807937?sv=2020-08-04&st=2026-03-28T11%3A06%3A45Z&se=2026-03-28T11%3A31%3A45Z&sr=b&sp=r&sig=7f23fmGbsIqZU6HJRW5iVatDnJXvMHPQjJDV%2Bmbyo1c%3D)
2026-03-28 11:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296393/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296393>
2026-03-28 11:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302464/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302464>
2026-03-28 11:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240931/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240931>
2026-03-28 11:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF69%20ZBX-GB>
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302478/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac481310>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787027%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787027/600 saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e236790>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787062%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787062/600 saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794244/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794244>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcbf850>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK64WXM%252F698775727%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775727/600 saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 968e893f-f12d-5bf3-9181-e47269b48833
2026-03-28 11:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 968e893f-f12d-5bf3-9181-e47269b48833, skipping ID generation
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 968e893f-f12d-5bf3-9181-e47269b48833 sending to next pipeline
2026-03-28 11:06:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 968e893f-f12d-5bf3-9181-e47269b48833, identifier: BK64%20WXM
2026-03-28 11:06:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 968e893f-f12d-5bf3-9181-e47269b48833 with identifier: BK64%20WXM
2026-03-28 11:06:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 968e893f-f12d-5bf3-9181-e47269b48833 with identifier: BK64%20WXM
2026-03-28 11:06:57 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 968e893f-f12d-5bf3-9181-e47269b48833 with identifier: BK64%20WXM to the API
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:57 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775727/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_expert_report_file_b9810cc7-edd1-4335-add3-dbcb7b27247c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK64%20WXM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '968e893f-f12d-5bf3-9181-e47269b48833',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK64 WXM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK64%20WXM&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'TOYOTA',
'model': 'AVENSIS',
'odometer': 114178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775727/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775732/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775740/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775757/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775774/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775792/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96490,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775833/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88972,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 94543,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775911/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_968e893f-f12d-5bf3-9181-e47269b48833/968e893f-f12d-5bf3-9181-e47269b48833_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88096,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK64WXM/698775947/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'TOYOTA AVENSIS 2.0 D-4D ICON BUSINESS ED. Estate',
'transmission': 'manual',
'trim': 'D-4D ICON BUSINESS ED.',
'vin': 'SB1ED76L70E136136',
'year': 2014}
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520WXM%27 HTTP/1.1" 200 None
2026-03-28 11:06:57 [bca.uk] INFO: Saving data for BK64%20WXM: {'created_time': 1774696017.871188, 'last_price_update_time': 1774696017.871198, 'auction_closing_time': 1775037600.0}
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK64%2520WXM') HTTP/1.1" 204 0
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818321/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794258/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147491/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:57 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818273/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818273>
2026-03-28 11:06:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240931/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24a090>
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:57 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFP70XEN%252F698787041%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787041/600 saved to cache
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09367c6e-3396-5657-95ea-a9c92174c186
2026-03-28 11:06:57 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09367c6e-3396-5657-95ea-a9c92174c186, skipping ID generation
2026-03-28 11:06:57 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09367c6e-3396-5657-95ea-a9c92174c186 sending to next pipeline
2026-03-28 11:06:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09367c6e-3396-5657-95ea-a9c92174c186, identifier: FP70%20XEN
2026-03-28 11:06:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09367c6e-3396-5657-95ea-a9c92174c186 with identifier: FP70%20XEN
2026-03-28 11:06:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09367c6e-3396-5657-95ea-a9c92174c186 with identifier: FP70%20XEN
2026-03-28 11:06:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09367c6e-3396-5657-95ea-a9c92174c186 with identifier: FP70%20XEN to the API
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:06:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787041/600>
{'auction_title': '',
'c_o_2_emission_value': 126,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_expert_report_file_7bec89ac-68dd-44ab-9d9e-3fce75498b7c.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FP70%20XEN-GB',
'category': 'Car',
'color': 'orange',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '09367c6e-3396-5657-95ea-a9c92174c186',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FP70 XEN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FP70%20XEN&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 53928,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52056,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787027/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49161,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787062/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45309,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45660,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45808,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787105/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81164,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787126/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68984,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787149/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86822,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09367c6e-3396-5657-95ea-a9c92174c186/09367c6e-3396-5657-95ea-a9c92174c186_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61763,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FP70XEN/698787222/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 TURBO 100 SE PREMIUM Hatchback',
'transmission': 'manual',
'trim': 'TURBO 100 SE PREMIUM',
'vin': 'VXKUPHNKKL4473239',
'year': 2020}
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP70%2520XEN%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [bca.uk] INFO: Saving data for FP70%20XEN: {'created_time': 1774696018.390492, 'last_price_update_time': 1774696018.390502, 'auction_closing_time': 1774951200.0}
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FP70%2520XEN') HTTP/1.1" 204 0
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac24b590>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302478%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302478/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3f9d0>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_expert_report_file_bcd3ad3b-f96b-46e1-8f98-ef103c4fc6fc.pdf HTTP/1.1" 201 0
2026-03-28 11:06:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e, skipping ID generation
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLR18TNX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR18TNX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302464/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296378/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296378>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698147475>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822443>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240930/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240930>
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296393/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817943%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817943 not downloaded yet
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fe9d0>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818321%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818321/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac316f50>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822489%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822489/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e962150>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794258%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794258/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bbb50>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147491%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147491/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eae98d0>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240931%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240931/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817971%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817971 not downloaded yet
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794244/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818273/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302459>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240927/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240927>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV64%20RDZ-GB>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD13%20YCM-GB>
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698817993%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817993 not downloaded yet
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818015%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818015 not downloaded yet
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e9610>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_expert_report_file_d3214571-8711-4570-8b20-f8d8e1fe1bf8.pdf HTTP/1.1" 201 0
2026-03-28 11:06:58 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:06:58 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc1c110a-0c19-52b7-9903-ae3b1603e9d0, skipping ID generation
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSF69ZBX-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SF69ZBX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fecbf90>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302464%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302464/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:58 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff5db50>
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:58 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296393%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296393/600 saved to cache
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302455/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302455>
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240930/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD65%20HPZ-GB>
2026-03-28 11:06:58 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX65%20UOP-GB>
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818041%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818041 not downloaded yet
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690137%27 HTTP/1.1" 200 None
2026-03-28 11:06:58 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690137 not downloaded yet
2026-03-28 11:06:58 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296378/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818073%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818073 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690154%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690154 not downloaded yet
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817943/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817943>
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817923/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LR18TNX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240927/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaeb3d0>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794244%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794244/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc8ab50>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818273%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818273/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818098%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818098 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690172%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690172 not downloaded yet
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YF18DCZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb93dd0>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147475%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147475/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb01ad0>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240930%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240930/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e28ab10>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822443%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822443/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:06:59 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:06:59 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:59 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:06:59 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea2cd50>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296378%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296378/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818123%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818123 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690205%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690205 not downloaded yet
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690118/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SF69ZBX-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302455/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818142%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818142 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690225%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690225 not downloaded yet
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb92950>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302459%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302459/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e1850>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240927%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240927/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818015>
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817993>
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690300%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690300 not downloaded yet
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690344%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690344 not downloaded yet
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4abf10>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_expert_report_file_a67ea902-4690-4260-823b-5f695bfbe668.pdf HTTP/1.1" 201 0
2026-03-28 11:06:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a253646d-ff93-5f25-9bed-24b8b03cc5a0, skipping ID generation
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD13YCM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD13YCM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb5b450>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_expert_report_file_958ecba8-8a1d-42cd-bd5c-c33090cd0253.pdf HTTP/1.1" 201 0
2026-03-28 11:06:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84d34793-f006-56e8-8992-e370c8ef535e, skipping ID generation
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNV64RDZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NV64RDZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f5ed0>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302455%252F600') HTTP/1.1" 204 0
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302455/600 saved to cache
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690384%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690384 not downloaded yet
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817923/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817971/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817971>
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817943/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YF18DCZ/42808017?sv=2020-08-04&st=2026-03-28T11%3A05%3A50Z&se=2026-03-28T11%3A30%3A50Z&sr=b&sp=r&sig=vKMFkDSrwLG%2BNuzYFJvoas9IaxlkEE43Dj3RHsvdPa4%3D)
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690137>
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818041/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818041>
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690172/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690172>
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691005%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691005 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302374%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302374 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690415%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690415 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691019%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691019 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302379%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302379 not downloaded yet
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcaed90>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_expert_report_file_85bd8629-d25e-42ab-82a4-c262d0092b7d.pdf HTTP/1.1" 201 0
2026-03-28 11:06:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6183ae08-4168-54ba-9249-65d4fca6cc28, skipping ID generation
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD65HPZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD65HPZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b8bd0>
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:06:59 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_expert_report_file_1ba8b2e6-ec44-4b81-ba23-d3f7c68e4498.pdf HTTP/1.1" 201 0
2026-03-28 11:06:59 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:06:59 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29014a30-aed7-566e-b25c-53a44c08e631, skipping ID generation
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DDX65UOP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX65UOP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690118/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691033%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691033 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302384%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302384 not downloaded yet
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817993/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:06:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818250%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818250 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781996%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781996 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691057%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691057 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302390%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302390 not downloaded yet
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690205>
2026-03-28 11:06:59 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818142/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818142>
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818283%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818283 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782014%27 HTTP/1.1" 200 None
2026-03-28 11:06:59 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782014 not downloaded yet
2026-03-28 11:06:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691087%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691087 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302395%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302395 not downloaded yet
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4dfd0>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698817923%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817923/600 saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac18cd90>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698817943%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817943/600 saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9f30d0>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYF18DCZ%252F698794236%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794236/600 saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 67600ccf-1252-5a76-8f87-7b1e24436699
2026-03-28 11:07:00 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 67600ccf-1252-5a76-8f87-7b1e24436699, skipping ID generation
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 67600ccf-1252-5a76-8f87-7b1e24436699 sending to next pipeline
2026-03-28 11:07:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 67600ccf-1252-5a76-8f87-7b1e24436699, identifier: YF18%20DCZ
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818041/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690225/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690225>
2026-03-28 11:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818123/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818123>
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690172/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818310%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818310 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782033%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782033 not downloaded yet
2026-03-28 11:07:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 67600ccf-1252-5a76-8f87-7b1e24436699 with identifier: YF18%20DCZ
2026-03-28 11:07:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 67600ccf-1252-5a76-8f87-7b1e24436699 with identifier: YF18%20DCZ
2026-03-28 11:07:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 67600ccf-1252-5a76-8f87-7b1e24436699 with identifier: YF18%20DCZ to the API
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794236/600>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_expert_report_file_8587a7f4-6c85-4846-a92b-409e403ed128.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YF18%20DCZ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '67600ccf-1252-5a76-8f87-7b1e24436699',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YF18 DCZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YF18%20DCZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'BMW',
'model': '118I',
'odometer': 79032,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794236/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45796,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794238/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794244/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46160,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794258/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43064,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77259,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64960,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_67600ccf-1252-5a76-8f87-7b1e24436699/67600ccf-1252-5a76-8f87-7b1e24436699_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93281,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YF18DCZ/698794307/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 118I 1.5 SPORT Hatchback',
'transmission': 'manual',
'trim': 'SPORT',
'vin': 'WBA1R520807A50933',
'year': 2018}
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF18%2520DCZ%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [bca.uk] INFO: Saving data for YF18%20DCZ: {'created_time': 1774696020.784703, 'last_price_update_time': 1774696020.784715, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YF18%2520DCZ') HTTP/1.1" 204 0
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691156%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691156 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302404%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302404 not downloaded yet
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb69a10>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690118%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690118/600 saved to cache
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817971/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:07:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302365/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NV64RDZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818335%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818335 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782055%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782055 not downloaded yet
2026-03-28 11:07:00 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296408/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691180%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691180 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302413%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302413 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818355%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818355 not downloaded yet
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782083%27 HTTP/1.1" 200 None
2026-03-28 11:07:00 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782083 not downloaded yet
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bf7d0>
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:00 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698817993%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817993/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ba210>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698818015%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818015/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb59d90>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698818041%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818041/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e980e50>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690172%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690172/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302379/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302379>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818233/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD65HPZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698690997/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD13YCM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691209%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691209 not downloaded yet
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302423%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302423 not downloaded yet
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781976/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DX65UOP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690344>
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818388%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818388 not downloaded yet
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782114%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782114 not downloaded yet
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818142/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691230%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691230 not downloaded yet
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698302429%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302429 not downloaded yet
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe6010>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690137%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690137/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac40cb90>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698817971%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817971/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e3810>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296408%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296408/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818411%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818411 not downloaded yet
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782155%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782155 not downloaded yet
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691087/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691087>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302395/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302395>
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818123/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818434%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818434 not downloaded yet
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782189%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782189 not downloaded yet
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea4bf90>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690205%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690205/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e281210>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698818142%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818142/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690225/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302365/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782014/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782014>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782055/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782055>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782033>
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818459%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818459 not downloaded yet
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782221%27 HTTP/1.1" 200 None
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782221 not downloaded yet
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff62b10>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698818123%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818123/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698690997/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302379/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818233/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4f950>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690225%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690225/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf92d0>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302365%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302365/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302423/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302423>
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781976/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691209/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691209>
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302395/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691087/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782155/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782155>
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4138d0>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698690997%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698690997/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97c190>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302379%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302379/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea15890>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818233%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818233/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782014/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782055/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818459/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818459>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782189/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782189>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782221>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818411/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818411>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818434/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818434>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd07490>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698781976%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781976/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdaaf50>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302395%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302395/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2404d0>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782033%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782033/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fda8190>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691087%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691087/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:01 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcb3550>
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:01 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690344%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690344/600 saved to cache
2026-03-28 11:07:01 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782083/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782083>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302429>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818388/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818388>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691230/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691230>
2026-03-28 11:07:01 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782114>
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782155/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691209/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:01 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302423/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdaa550>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782014%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782014/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d18d0>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782055%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782055/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782189/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818411/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818434/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818459/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818355/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818355>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302413/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302413>
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaeb290>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782155%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782155/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39a990>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691209%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691209/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac168510>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302423%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302423/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782083/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818388/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691230/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf4e10>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782189%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782189/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf9690>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782221%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782221/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac316dd0>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818411%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818411/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a54d0>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818434%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818434/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac314b90>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818459%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818459/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691180>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818335/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818335>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302404/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302404>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691156>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818283>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818310>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302390/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302390>
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302413/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffed690>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782114%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782114/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf6890>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698782083%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782083/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcb2150>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818388%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818388/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac295a90>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691230%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691230/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcb3850>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302429%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302429/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818250/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818250>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691033/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691033>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302384>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691057/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691057>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691019/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691019>
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781996/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781996>
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818355/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac5367d0>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302413%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302413/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302390/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:02 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690415/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690415>
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302404/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b2550>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818355%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818355/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691019/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781996/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX65UOP/42807479?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=%2FpLnFm3%2FWMW4iOz6DhZEmT95n609YVL0CKxHNHX9hKc%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691057/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691033/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e3010>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691180%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691180/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e288f50>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302390%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302390/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4ec50>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691156%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691156/600 saved to cache
2026-03-28 11:07:02 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:02 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb75a90>
2026-03-28 11:07:02 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302404%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302404/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690384/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690384>
2026-03-28 11:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690300>
2026-03-28 11:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691005>
2026-03-28 11:07:03 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302374>
2026-03-28 11:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818335/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690415/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:03 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818250/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD65HPZ/42808089?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=WDm0UVpOyR2at45wqshrvNUzlA%2FOMEDb%2FzNhdQImi6Y%3D)
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09cbd0>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691019%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691019/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb6b4d0>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX65UOP%252F698781996%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781996/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 29014a30-aed7-566e-b25c-53a44c08e631
2026-03-28 11:07:03 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 29014a30-aed7-566e-b25c-53a44c08e631, skipping ID generation
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 29014a30-aed7-566e-b25c-53a44c08e631 sending to next pipeline
2026-03-28 11:07:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 29014a30-aed7-566e-b25c-53a44c08e631, identifier: DX65%20UOP
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94aeb29810>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691057%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691057/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac16b010>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818283%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818283/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8ded0>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691033%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691033/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fffa910>
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:03 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302384%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302384/600 saved to cache
2026-03-28 11:07:03 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP
2026-03-28 11:07:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP
2026-03-28 11:07:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 29014a30-aed7-566e-b25c-53a44c08e631 with identifier: DX65%20UOP to the API
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781996/600>
{'auction_title': '',
'c_o_2_emission_value': 111,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_expert_report_file_1ba8b2e6-ec44-4b81-ba23-d3f7c68e4498.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX65%20UOP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '29014a30-aed7-566e-b25c-53a44c08e631',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX65 UOP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX65%20UOP&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'A200',
'odometer': 88215,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781976/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42593,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698781996/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782014/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43871,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44113,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782055/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782083/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782114/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86055,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782155/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89825,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782189/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_29014a30-aed7-566e-b25c-53a44c08e631/29014a30-aed7-566e-b25c-53a44c08e631_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX65UOP/698782221/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 2.1 CDI SPORT EDITION Hatchback',
'transmission': 'manual',
'trim': 'CDI SPORT EDITION',
'vin': 'WDD1760082V095195',
'year': 2015}
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX65%2520UOP%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [bca.uk] INFO: Saving data for DX65%20UOP: {'created_time': 1774696024.057289, 'last_price_update_time': 1774696024.057301, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX65%2520UOP') HTTP/1.1" 204 0
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818073/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818073>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690154/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690154>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147466/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NV21YRL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822398/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NY19XSW-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818232/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=DP21OWH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818098/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818098>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296357/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296357>
2026-03-28 11:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV64RDZ/42797673?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=aAv3YZUaWxjnWLRGaegSOvo7BWKKd5SjjTHHVa2vNis%3D)
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea15ad0>
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818335%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818335/600 saved to cache
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8cb10>
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818310%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818310/600 saved to cache
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:04 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:04 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:04 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:04 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff5e1d0>
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690415%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690415/600 saved to cache
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd1f5d0>
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD65HPZ%252F698818250%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818250/600 saved to cache
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6183ae08-4168-54ba-9249-65d4fca6cc28
2026-03-28 11:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6183ae08-4168-54ba-9249-65d4fca6cc28, skipping ID generation
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6183ae08-4168-54ba-9249-65d4fca6cc28 sending to next pipeline
2026-03-28 11:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6183ae08-4168-54ba-9249-65d4fca6cc28, identifier: LD65%20HPZ
2026-03-28 11:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6183ae08-4168-54ba-9249-65d4fca6cc28 with identifier: LD65%20HPZ
2026-03-28 11:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6183ae08-4168-54ba-9249-65d4fca6cc28 with identifier: LD65%20HPZ
2026-03-28 11:07:04 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6183ae08-4168-54ba-9249-65d4fca6cc28 with identifier: LD65%20HPZ to the API
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:04 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818250/600>
{'auction_title': '',
'c_o_2_emission_value': 94,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_expert_report_file_85bd8629-d25e-42ab-82a4-c262d0092b7d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD65%20HPZ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6183ae08-4168-54ba-9249-65d4fca6cc28',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD65 HPZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD65%20HPZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 106578,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818233/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44130,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818250/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44306,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818335/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41563,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818355/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 103128,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85641,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818411/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95775,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818434/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6183ae08-4168-54ba-9249-65d4fca6cc28/6183ae08-4168-54ba-9249-65d4fca6cc28_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD65HPZ/698818459/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.4 TDI 90 S Estate',
'transmission': 'manual',
'trim': 'TDI 90 S',
'vin': 'TMBKJ6NJ2GZ074410',
'year': 2015}
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD65%2520HPZ%27 HTTP/1.1" 200 None
2026-03-28 11:07:04 [bca.uk] INFO: Saving data for LD65%20HPZ: {'created_time': 1774696024.763702, 'last_price_update_time': 1774696024.763716, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD65%2520HPZ') HTTP/1.1" 204 0
2026-03-28 11:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD13YCM/42805959?sv=2020-08-04&st=2026-03-28T11%3A06%3A58Z&se=2026-03-28T11%3A31%3A58Z&sr=b&sp=r&sig=06nscUar1R0ankxe8%2F4XaOeEkf7Cv2dEBxVDkeoFcdE%3D)
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240922/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240922>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814176/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814176>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302450/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302450>
2026-03-28 11:07:04 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818137>
2026-03-28 11:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690384/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e961e50>
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:04 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV64RDZ%252F698302374%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302374/600 saved to cache
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 84d34793-f006-56e8-8992-e370c8ef535e
2026-03-28 11:07:04 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 84d34793-f006-56e8-8992-e370c8ef535e, skipping ID generation
2026-03-28 11:07:04 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 84d34793-f006-56e8-8992-e370c8ef535e sending to next pipeline
2026-03-28 11:07:04 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 84d34793-f006-56e8-8992-e370c8ef535e, identifier: NV64%20RDZ
2026-03-28 11:07:04 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818098/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:07:04 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 84d34793-f006-56e8-8992-e370c8ef535e with identifier: NV64%20RDZ
2026-03-28 11:07:04 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 84d34793-f006-56e8-8992-e370c8ef535e with identifier: NV64%20RDZ
2026-03-28 11:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 84d34793-f006-56e8-8992-e370c8ef535e with identifier: NV64%20RDZ to the API
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302374/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_expert_report_file_958ecba8-8a1d-42cd-bd5c-c33090cd0253.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV64%20RDZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '84d34793-f006-56e8-8992-e370c8ef535e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV64 RDZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV64%20RDZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SKODA',
'model': 'OCTAVIA',
'odometer': 109203,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43888,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302365/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302374/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44363,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302379/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45582,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302384/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40632,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302390/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38929,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302395/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105364,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302404/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79544,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302413/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302423/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_84d34793-f006-56e8-8992-e370c8ef535e/84d34793-f006-56e8-8992-e370c8ef535e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83648,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV64RDZ/698302429/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'SKODA OCTAVIA 1.6 TDI CR 105 BLACK EDITION Hatchback',
'transmission': 'manual',
'trim': 'TDI CR 105 BLACK EDITION',
'vin': 'TMBBG7NE3F0032984',
'year': 2015}
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV64%2520RDZ%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [bca.uk] INFO: Saving data for NV64%20RDZ: {'created_time': 1774696025.276863, 'last_price_update_time': 1774696025.276876, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV64%2520RDZ') HTTP/1.1" 204 0
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822398/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NY19XSW/42786978?sv=2020-08-04&st=2026-03-28T11%3A05%3A48Z&se=2026-03-28T11%3A30%3A48Z&sr=b&sp=r&sig=5FVxuu3c8NgD8IoV424BPI7ByeLswILSFitcenyrrqE%3D)
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690154/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SF69ZBX/42805950?sv=2020-08-04&st=2026-03-28T11%3A06%3A56Z&se=2026-03-28T11%3A31%3A56Z&sr=b&sp=r&sig=APhA3rKllfHrlMbW11%2BTzqDl92O25luWmEHJaGT5mxc%3D)
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147466/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NV21YRL/42795803?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=nbX503x044bzLWcg6V1xoxUFHBJ0TnY1Vvrm4No3EkI%3D)
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818232/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DP21OWH/42807579?sv=2020-08-04&st=2026-03-28T11%3A05%3A49Z&se=2026-03-28T11%3A30%3A49Z&sr=b&sp=r&sig=gKmrXr92CUURqdhO2%2B9AeqgdrcmU9wCPRHcsCwIBOuw%3D)
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296357/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM14%20HWD-GB>
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818073/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LR18TNX/42808436?sv=2020-08-04&st=2026-03-28T11%3A06%3A55Z&se=2026-03-28T11%3A31%3A55Z&sr=b&sp=r&sig=yqsV812nhXLyJLgalvMrIGbpyxdAtaW2FLIzZkdbiCU%3D)
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94af4b3e10>
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD13YCM%252F698691005%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691005/600 saved to cache
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a253646d-ff93-5f25-9bed-24b8b03cc5a0
2026-03-28 11:07:05 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a253646d-ff93-5f25-9bed-24b8b03cc5a0, skipping ID generation
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a253646d-ff93-5f25-9bed-24b8b03cc5a0 sending to next pipeline
2026-03-28 11:07:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a253646d-ff93-5f25-9bed-24b8b03cc5a0, identifier: BD13%20YCM
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf87d0>
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690384%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690384/600 saved to cache
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e238ad0>
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690300%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690300/600 saved to cache
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:05 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac476050>
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698818098%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818098/600 saved to cache
2026-03-28 11:07:05 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM
2026-03-28 11:07:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM
2026-03-28 11:07:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a253646d-ff93-5f25-9bed-24b8b03cc5a0 with identifier: BD13%20YCM to the API
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691005/600>
{'auction_title': '',
'c_o_2_emission_value': 162,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_expert_report_file_a67ea902-4690-4260-823b-5f695bfbe668.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD13%20YCM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a253646d-ff93-5f25-9bed-24b8b03cc5a0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD13 YCM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD13%20YCM&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'E350',
'odometer': 154478,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42189,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698690997/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42270,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45857,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691019/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43681,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691033/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41701,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691057/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42159,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691087/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691156/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62921,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65267,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691209/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a253646d-ff93-5f25-9bed-24b8b03cc5a0/a253646d-ff93-5f25-9bed-24b8b03cc5a0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76677,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD13YCM/698691230/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E350 3.0 B/TEC AMG SPORT TIP Estate',
'transmission': 'manual',
'trim': 'B/TEC AMG SPORT TIP',
'vin': 'WDD2122262A837709',
'year': 2013}
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD13%2520YCM%27 HTTP/1.1" 200 None
2026-03-28 11:07:05 [bca.uk] INFO: Saving data for BD13%20YCM: {'created_time': 1774696025.934058, 'last_price_update_time': 1774696025.934072, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD13%2520YCM') HTTP/1.1" 204 0
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302450/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240918/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=696240918>
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240922/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296352/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296352>
2026-03-28 11:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814144/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814144>
2026-03-28 11:07:05 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD66%20EUB-GB>
2026-03-28 11:07:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e861350>
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:05 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:05 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNY19XSW%252F698822398%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822398/600 saved to cache
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 20371ec6-8910-5760-a0a1-418fe02be3ea
2026-03-28 11:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 20371ec6-8910-5760-a0a1-418fe02be3ea, skipping ID generation
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 20371ec6-8910-5760-a0a1-418fe02be3ea sending to next pipeline
2026-03-28 11:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 20371ec6-8910-5760-a0a1-418fe02be3ea, identifier: NY19%20XSW
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3bdd0>
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSF69ZBX%252F698690154%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690154/600 saved to cache
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0
2026-03-28 11:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc1c110a-0c19-52b7-9903-ae3b1603e9d0, skipping ID generation
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc1c110a-0c19-52b7-9903-ae3b1603e9d0 sending to next pipeline
2026-03-28 11:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc1c110a-0c19-52b7-9903-ae3b1603e9d0, identifier: SF69%20ZBX
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d0c50>
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNV21YRL%252F698147466%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147466/600 saved to cache
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 315975b4-353c-5208-8d12-be9533c8f6fb
2026-03-28 11:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 315975b4-353c-5208-8d12-be9533c8f6fb, skipping ID generation
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 315975b4-353c-5208-8d12-be9533c8f6fb sending to next pipeline
2026-03-28 11:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 315975b4-353c-5208-8d12-be9533c8f6fb, identifier: NV21%20YRL
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac413490>
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDP21OWH%252F698818232%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818232/600 saved to cache
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 9193af3e-cf78-59fe-adc3-c5316e575c5a
2026-03-28 11:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 9193af3e-cf78-59fe-adc3-c5316e575c5a, skipping ID generation
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 9193af3e-cf78-59fe-adc3-c5316e575c5a sending to next pipeline
2026-03-28 11:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9193af3e-cf78-59fe-adc3-c5316e575c5a, identifier: DP21%20OWH
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff61bd0>
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296357%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296357/600 saved to cache
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:07:06 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:06 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:06 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:06 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a8c10>
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:06 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLR18TNX%252F698818073%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818073/600 saved to cache
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e
2026-03-28 11:07:06 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e, skipping ID generation
2026-03-28 11:07:06 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e sending to next pipeline
2026-03-28 11:07:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e, identifier: LR18%20TNX
2026-03-28 11:07:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814176/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:07:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW
2026-03-28 11:07:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW
2026-03-28 11:07:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 20371ec6-8910-5760-a0a1-418fe02be3ea with identifier: NY19%20XSW to the API
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822398/600>
{'auction_title': '',
'c_o_2_emission_value': 104,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_expert_report_file_7ee76f5d-b762-4636-a222-7897f8e5b690.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NY19%20XSW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '20371ec6-8910-5760-a0a1-418fe02be3ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NY19 XSW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NY19%20XSW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 43562,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46421,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822398/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45319,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822426/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45586,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822467/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44962,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822505/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81616,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822526/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822546/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822571/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_20371ec6-8910-5760-a0a1-418fe02be3ea/20371ec6-8910-5760-a0a1-418fe02be3ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NY19XSW/698822593/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.0 IG-T 100 ACENTA Hatchback',
'transmission': 'manual',
'trim': 'IG-T 100 ACENTA',
'vin': 'VNVK1400162293296',
'year': 2019}
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NY19%2520XSW%27 HTTP/1.1" 200 None
2026-03-28 11:07:07 [bca.uk] INFO: Saving data for NY19%20XSW: {'created_time': 1774696027.019515, 'last_price_update_time': 1774696027.019526, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NY19%2520XSW') HTTP/1.1" 204 0
2026-03-28 11:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX
2026-03-28 11:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX
2026-03-28 11:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc1c110a-0c19-52b7-9903-ae3b1603e9d0 with identifier: SF69%20ZBX to the API
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690154/600>
{'auction_title': '',
'c_o_2_emission_value': 195,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_expert_report_file_d3214571-8711-4570-8b20-f8d8e1fe1bf8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SF69%20ZBX-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '3.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'dc1c110a-0c19-52b7-9903-ae3b1603e9d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SF69 ZBX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SF69%20ZBX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'LAND ROVER',
'model': 'R/R SPORT',
'odometer': 103892,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45904,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690118/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690154/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42473,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690172/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43126,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42043,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690225/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89868,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83629,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690384/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc1c110a-0c19-52b7-9903-ae3b1603e9d0/dc1c110a-0c19-52b7-9903-ae3b1603e9d0_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70513,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SF69ZBX/698690415/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R SPORT 3.0 SDV6 306 HSE StationWagon',
'transmission': 'automatic',
'trim': 'SDV6 306 HSE',
'vin': 'SALWA2AK3LA888981',
'year': 2019}
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF69%2520ZBX%27 HTTP/1.1" 200 None
2026-03-28 11:07:07 [bca.uk] INFO: Saving data for SF69%20ZBX: {'created_time': 1774696027.432456, 'last_price_update_time': 1774696027.432473, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SF69%2520ZBX') HTTP/1.1" 204 0
2026-03-28 11:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 315975b4-353c-5208-8d12-be9533c8f6fb with identifier: NV21%20YRL
2026-03-28 11:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 315975b4-353c-5208-8d12-be9533c8f6fb with identifier: NV21%20YRL
2026-03-28 11:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 315975b4-353c-5208-8d12-be9533c8f6fb with identifier: NV21%20YRL to the API
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147466/600>
{'auction_title': '',
'c_o_2_emission_value': 156,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_expert_report_file_2633d90f-2096-4c70-ae7a-cbead1af4fd9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NV21%20YRL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '315975b4-353c-5208-8d12-be9533c8f6fb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NV21 YRL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NV21%20YRL&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'AUDI',
'model': 'A4',
'odometer': 32508,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147466/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48457,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147475/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46058,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147482/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147491/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97572,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88613,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147549/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101829,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147559/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_315975b4-353c-5208-8d12-be9533c8f6fb/315975b4-353c-5208-8d12-be9533c8f6fb_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81443,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NV21YRL/698147572/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'AUDI A4 2.0 35 TFSI BLACK ED.S-T Saloon',
'transmission': 'automatic',
'trim': '35 TFSI BLACK ED.S-T',
'vin': 'WAUZZZF44MA071324',
'year': 2021}
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV21%2520YRL%27 HTTP/1.1" 200 None
2026-03-28 11:07:07 [bca.uk] INFO: Saving data for NV21%20YRL: {'created_time': 1774696027.860013, 'last_price_update_time': 1774696027.860024, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NV21%2520YRL') HTTP/1.1" 204 0
2026-03-28 11:07:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH
2026-03-28 11:07:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH
2026-03-28 11:07:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9193af3e-cf78-59fe-adc3-c5316e575c5a with identifier: DP21%20OWH to the API
2026-03-28 11:07:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818232/600>
{'auction_title': '',
'c_o_2_emission_value': 141,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_expert_report_file_5df941cd-1fd2-4a87-8a7f-8b555dbdcb9a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DP21%20OWH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9193af3e-cf78-59fe-adc3-c5316e575c5a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DP21 OWH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DP21%20OWH&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'GRANDLAND X',
'odometer': 28083,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818232/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46480,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818249/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46035,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818273/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47330,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42778,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818343/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100141,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65703,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818428/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_9193af3e-cf78-59fe-adc3-c5316e575c5a/9193af3e-cf78-59fe-adc3-c5316e575c5a_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81007,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DP21OWH/698818458/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'VAUXHALL GRANDLAND X 1.2 T 130 SRI Hatchback',
'transmission': 'manual',
'trim': 'T 130 SRI',
'vin': 'W0VZRHNS9M6832547',
'year': 2021}
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP21%2520OWH%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [bca.uk] INFO: Saving data for DP21%20OWH: {'created_time': 1774696028.342441, 'last_price_update_time': 1774696028.342453, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DP21%2520OWH') HTTP/1.1" 204 0
2026-03-28 11:07:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX
2026-03-28 11:07:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX
2026-03-28 11:07:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e with identifier: LR18%20TNX to the API
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818073/600>
{'auction_title': '',
'c_o_2_emission_value': 49,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_expert_report_file_bcd3ad3b-f96b-46e1-8f98-ef103c4fc6fc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LR18%20TNX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LR18 TNX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LR18%20TNX&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'MERCEDES-BENZ',
'model': 'E350 E',
'odometer': 128137,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46369,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817923/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46086,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817943/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817971/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698817993/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41558,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41300,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818041/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105595,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818073/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818098/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96017,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818123/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e/849f2ad9-d3e5-52f2-b9db-a3a3f6f4496e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89570,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LR18TNX/698818142/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E350 E 2.0 SE 9G Saloon',
'transmission': 'manual',
'trim': 'SE 9G',
'vin': 'WDD2130502A438759',
'year': 2018}
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520TNX%27 HTTP/1.1" 200 None
2026-03-28 11:07:08 [bca.uk] INFO: Saving data for LR18%20TNX: {'created_time': 1774696028.76876, 'last_price_update_time': 1774696028.768773, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LR18%2520TNX') HTTP/1.1" 204 0
2026-03-28 11:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818112/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818112>
2026-03-28 11:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP69%20DTN-GB>
2026-03-28 11:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296344>
2026-03-28 11:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML11%20YCS-GB>
2026-03-28 11:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302444/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698302444>
2026-03-28 11:07:08 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814108/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814108>
2026-03-28 11:07:08 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe48cd0>
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302450%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302450/600 saved to cache
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09c0d0>
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240922%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240922/600 saved to cache
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9f21d0>
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698818137%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818137/600 saved to cache
2026-03-28 11:07:08 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:08 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb92bd0>
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:08 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:08 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814176%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814176/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818156/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818156>
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796862/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796862>
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240915/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MF17NRO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296352/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240918/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814144/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebeda50>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_expert_report_file_977ded88-ff73-4da6-b0d9-64c7e3bd7758.pdf HTTP/1.1" 201 0
2026-03-28 11:07:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c61e304-7d9e-5e1f-8212-e5585370b47b, skipping ID generation
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKM14HWD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM14HWD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649487%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649487 not downloaded yet
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YH09BCO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649498%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649498 not downloaded yet
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649513%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649513 not downloaded yet
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649528%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649528 not downloaded yet
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb6b450>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296352%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296352/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39aa50>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240918%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240918/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814108/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302444/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649542%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649542 not downloaded yet
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818088/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818088>
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240915/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MF17NRO/42758052?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=TLAmdisXKvB0gEM4RgxwlCY7%2F8%2FI8swKQhKzDI524q8%3D)
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818112/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e4990>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814144%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814144/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796862/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649577%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649577 not downloaded yet
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649607%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649607 not downloaded yet
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebd5dd0>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_expert_report_file_af49ad95-d18b-467f-af02-ab5ba906decc.pdf HTTP/1.1" 201 0
2026-03-28 11:07:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79920aac-a0d8-5e9e-8565-6a33b873ebb2, skipping ID generation
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD66EUB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD66EUB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb699d0>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296344%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296344/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YH09BCO/42797616?sv=2020-08-04&st=2026-03-28T11%3A05%3A47Z&se=2026-03-28T11%3A30%3A47Z&sr=b&sp=r&sig=H%2B6MJk0GNLKYEuY21BPOQUmlzZRnSuHZNQD4Ldprt7A%3D)
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ64%20LVP-GB>
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296332>
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649471/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM14HWD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649498/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649498>
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649629%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649629 not downloaded yet
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818241%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818241 not downloaded yet
2026-03-28 11:07:09 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GR55%20ULB-GB>
2026-03-28 11:07:09 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818156/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698649657%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649657 not downloaded yet
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818255%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818255 not downloaded yet
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e861e90>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814108%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814108/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc91f50>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302444%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302444/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb02250>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_expert_report_file_f4212057-cfe7-4de0-89e3-d20cb4c84039.pdf HTTP/1.1" 201 0
2026-03-28 11:07:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64370ae9-ee70-5b55-bab3-19bba1b36cad, skipping ID generation
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DKP69DTN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP69DTN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e89a690>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMF17NRO%252F696240915%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240915/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 30856a3b-be0e-5168-89b3-4f62e251696e
2026-03-28 11:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 30856a3b-be0e-5168-89b3-4f62e251696e, skipping ID generation
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 30856a3b-be0e-5168-89b3-4f62e251696e sending to next pipeline
2026-03-28 11:07:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 30856a3b-be0e-5168-89b3-4f62e251696e, identifier: MF17%20NRO
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0e0d0>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698818112%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818112/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:09 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebd6350>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796862%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796862/600 saved to cache
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3cad50>
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:09 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_expert_report_file_3529c1db-4a5c-483f-acbf-d0859704cb78.pdf HTTP/1.1" 201 0
2026-03-28 11:07:09 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:09 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b24e560b-d815-5611-8097-f663470ed43b, skipping ID generation
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DML11YCS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML11YCS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818278%27 HTTP/1.1" 200 None
2026-03-28 11:07:09 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818278 not downloaded yet
2026-03-28 11:07:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 30856a3b-be0e-5168-89b3-4f62e251696e with identifier: MF17%20NRO
2026-03-28 11:07:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 30856a3b-be0e-5168-89b3-4f62e251696e with identifier: MF17%20NRO
2026-03-28 11:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 30856a3b-be0e-5168-89b3-4f62e251696e with identifier: MF17%20NRO to the API
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240915/600>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_expert_report_file_6c0a7081-a1b2-4262-9e90-11a935ce82c7.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MF17%20NRO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '30856a3b-be0e-5168-89b3-4f62e251696e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MF17 NRO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MF17%20NRO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SSANGYONG',
'model': 'KORANDO',
'odometer': 72065,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42721,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240915/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43084,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240918/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42468,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240922/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42275,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240927/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40930,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240930/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41953,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240931/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 105463,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80592,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240946/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85432,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_30856a3b-be0e-5168-89b3-4f62e251696e/30856a3b-be0e-5168-89b3-4f62e251696e_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96235,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MF17NRO/696240951/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'SSANGYONG KORANDO 2.2 D 178 SE 4WD StationWagon',
'transmission': 'manual',
'trim': 'D 178 SE 4WD',
'vin': 'KPTB0A1WSHP250260',
'year': 2017}
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF17%2520NRO%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [bca.uk] INFO: Saving data for MF17%20NRO: {'created_time': 1774696030.339479, 'last_price_update_time': 1774696030.339491, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MF17%2520NRO') HTTP/1.1" 204 0
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649577/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649577>
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649528/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649528>
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649487/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649487>
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649513/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649513>
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818129/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818129>
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814071/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814071>
2026-03-28 11:07:10 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649542/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649542>
2026-03-28 11:07:10 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818088/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811749%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811749 not downloaded yet
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798191%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798191 not downloaded yet
2026-03-28 11:07:10 [scrapy.extensions.logstats] INFO: Crawled 180 pages (at 29 pages/min), scraped 381 items (at 57 items/min)
2026-03-28 11:07:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818296%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818296 not downloaded yet
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811762%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811762 not downloaded yet
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798214%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798214 not downloaded yet
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e241590>
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYH09BCO%252F698302443%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302443/600 saved to cache
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0d1fbca2-7850-5db9-a352-21626963fd57
2026-03-28 11:07:10 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0d1fbca2-7850-5db9-a352-21626963fd57, skipping ID generation
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0d1fbca2-7850-5db9-a352-21626963fd57 sending to next pipeline
2026-03-28 11:07:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0d1fbca2-7850-5db9-a352-21626963fd57, identifier: YH09%20BCO
2026-03-28 11:07:10 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:10 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:10 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:10 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e281810>
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:10 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818156%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818156/600 saved to cache
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818319%27 HTTP/1.1" 200 None
2026-03-28 11:07:10 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818319 not downloaded yet
2026-03-28 11:07:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO
2026-03-28 11:07:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO
2026-03-28 11:07:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0d1fbca2-7850-5db9-a352-21626963fd57 with identifier: YH09%20BCO to the API
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302443/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_expert_report_file_8f1f44b4-4e25-4ef2-a6d0-d3c7d0c24879.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YH09%20BCO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0d1fbca2-7850-5db9-a352-21626963fd57',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YH09 BCO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YH09%20BCO&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'BMW',
'model': '520D',
'odometer': 138062,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42986,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44308,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302444/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44265,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302450/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302455/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43422,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302459/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42587,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302464/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90688,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302478/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85215,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302485/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0d1fbca2-7850-5db9-a352-21626963fd57/0d1fbca2-7850-5db9-a352-21626963fd57_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YH09BCO/698302489/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 177 M SPORT BUSINESS ED.TOURIN Estate',
'transmission': 'automatic',
'trim': '177 M SPORT BUSINESS ED.TOURIN',
'vin': 'WBAPX32070C186589',
'year': 2009}
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH09%2520BCO%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [bca.uk] INFO: Saving data for YH09%20BCO: {'created_time': 1774696031.036963, 'last_price_update_time': 1774696031.036975, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YH09%2520BCO') HTTP/1.1" 204 0
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649471/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649498/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649607>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818224/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD66EUB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649542/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811775%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811775 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798235%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798235 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818353%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818353 not downloaded yet
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad2f6550>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698818088%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818088/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811788%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811788 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798251%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798251 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818376%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818376 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811812%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811812 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798262%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798262 not downloaded yet
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9f0b50>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649471%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649471/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d29d0>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649498%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649498/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea4a190>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296332%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296332/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e6a10>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649542%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649542/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818402%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818402 not downloaded yet
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814071/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649513/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649528/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649487/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798178/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=ML11YCS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818129/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811839%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811839 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798280%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798280 not downloaded yet
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649577/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818427%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818427 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811868%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811868 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798305%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798305 not downloaded yet
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e97e490>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_expert_report_file_181e4237-3d60-4007-b536-7a2ec7ba27e2.pdf HTTP/1.1" 201 0
2026-03-28 11:07:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caf399da-ba62-5f8c-8c9c-a7254fd592b8, skipping ID generation
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DGR55ULB-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GR55ULB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818224/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811894%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811894 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798318%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798318 not downloaded yet
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818319/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818319>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811762/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811762>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818296/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818296>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798214/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798214>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798235/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798235>
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818265%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818265 not downloaded yet
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698811914%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811914 not downloaded yet
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698798338%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798338 not downloaded yet
2026-03-28 11:07:11 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798178/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818292%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818292 not downloaded yet
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdfab90>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_expert_report_file_7baa1484-f0ce-4f2d-8d37-bf4ab9f0c209.pdf HTTP/1.1" 201 0
2026-03-28 11:07:11 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:11 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6593b689-aaea-5140-bace-f18f7c63a758, skipping ID generation
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPJ64LVP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ64LVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac39a410>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814071%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814071/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eab5fd0>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649513%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649513/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb02f10>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649528%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649528/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eab6a90>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649487%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649487/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaee6d0>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818129%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818129/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:11 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ff590>
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:11 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649577%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649577/600 saved to cache
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818308%27 HTTP/1.1" 200 None
2026-03-28 11:07:11 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818308 not downloaded yet
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818376/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818376>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798251>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818353/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818353>
2026-03-28 11:07:11 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811812>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818402/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818402>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798262>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811788/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811788>
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691114%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691114 not downloaded yet
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9d650>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818224%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818224/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818328%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818328 not downloaded yet
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798235/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691131%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691131 not downloaded yet
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818341%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818341 not downloaded yet
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e510f10>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649607%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649607/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff7f710>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798178%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798178/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691159%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691159 not downloaded yet
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798214/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811762/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798338>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798318>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818243/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GR55ULB-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818296/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818319/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818372%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818372 not downloaded yet
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691175%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691175 not downloaded yet
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcaee90>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798235%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798235/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818399%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818399 not downloaded yet
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811788/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691194%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691194 not downloaded yet
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818419%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818419 not downloaded yet
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691236%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691236 not downloaded yet
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698818442%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818442 not downloaded yet
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818328/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818328>
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691272%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691272 not downloaded yet
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea600d0>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798214%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798214/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad151f10>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811762%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811762/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea77750>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818296%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818296/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e288d50>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818319%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818319/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818243/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818402/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818353/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818376/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691300%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691300 not downloaded yet
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bea50>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811788%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811788/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698691324%27 HTTP/1.1" 200 None
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691324 not downloaded yet
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2994d0>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811812%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811812/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2bd90>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798262%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798262/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691159/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691159>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818399>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691114/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691114>
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818328/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691131/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691131>
2026-03-28 11:07:12 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818341/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818341>
2026-03-28 11:07:12 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffa4c90>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798251%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798251/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdaa5d0>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818243%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818243/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf9150>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818402%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818402/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaee3d0>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818353%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818353/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac169a50>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818376%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818376/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:12 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf9190>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798318%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798318/600 saved to cache
2026-03-28 11:07:12 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e5690>
2026-03-28 11:07:12 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818328%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818328/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4c750>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798338%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798338/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818372/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818372>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691194/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691194>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691236/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691236>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691175>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691272>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818442/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818442>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818419/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818419>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818341/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818419/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691300/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691300>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818308>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691131/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691159/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691324/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698691324>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8d3190>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818341%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818341/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691114/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691236/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691194/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691090/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PJ64LVP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818372/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818442/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3caad0>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818419%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818419/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818292>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818265/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818265>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691324/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811894/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811894>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac45fc50>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691131%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691131/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e513010>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691159%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691159/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a43d0>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818399%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818399/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811914/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811914>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691300/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811868/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811868>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798305>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e422690>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691114%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691114/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e897890>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691236%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691236/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf7010>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691194%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691194/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3e3d0>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691175%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691175/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffec0d0>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818372%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818372/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf7210>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818442%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818442/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcadb50>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691272%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691272/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e610e90>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818308%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818308/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd3c210>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691324%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691324/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691090/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PJ64LVP/42805938?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=Eh0Ws7IigyCDNQuzV4F8XswOxmYdX5%2BkmfSNEHE57wA%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798280/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798280>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811839/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811839>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818427/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818427>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811775/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811775>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798191>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811894/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:13 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e876990>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691300%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691300/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818278>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KP69DTN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:13 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811749/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698811749>
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818265/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GR55ULB/42808018?sv=2020-08-04&st=2026-03-28T11%3A07%3A09Z&se=2026-03-28T11%3A32%3A09Z&sr=b&sp=r&sig=J6vMgDCdxJxSm9RDf56yt8gPMvnyp8w3cJrKTR7%2Fl%2Fo%3D)
2026-03-28 11:07:13 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811868/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e898150>
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:13 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPJ64LVP%252F698691090%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691090/600 saved to cache
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 6593b689-aaea-5140-bace-f18f7c63a758
2026-03-28 11:07:13 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6593b689-aaea-5140-bace-f18f7c63a758, skipping ID generation
2026-03-28 11:07:13 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6593b689-aaea-5140-bace-f18f7c63a758 sending to next pipeline
2026-03-28 11:07:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6593b689-aaea-5140-bace-f18f7c63a758, identifier: PJ64%20LVP
2026-03-28 11:07:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP
2026-03-28 11:07:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP
2026-03-28 11:07:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6593b689-aaea-5140-bace-f18f7c63a758 with identifier: PJ64%20LVP to the API
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:14 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691090/600>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_expert_report_file_7baa1484-f0ce-4f2d-8d37-bf4ab9f0c209.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PJ64%20LVP-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '6593b689-aaea-5140-bace-f18f7c63a758',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PJ64 LVP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PJ64%20LVP&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'KIA',
'model': 'CEED',
'odometer': 65079,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44874,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691090/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41715,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691114/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691131/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43232,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691159/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43040,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41527,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691194/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87124,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691236/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691272/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691300/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6593b689-aaea-5140-bace-f18f7c63a758/6593b689-aaea-5140-bace-f18f7c63a758_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PJ64LVP/698691324/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'KIA CEED 1.4 2 Hatchback',
'transmission': 'manual',
'trim': '2',
'vin': 'U5YHN511LFL164158',
'year': 2014}
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ64%2520LVP%27 HTTP/1.1" 200 None
2026-03-28 11:07:14 [bca.uk] INFO: Saving data for PJ64%20LVP: {'created_time': 1774696034.7769, 'last_price_update_time': 1774696034.776913, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PJ64%2520LVP') HTTP/1.1" 204 0
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811914/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811775/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:14 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818255/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818255>
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811839/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798280/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/ML11YCS/42807036?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=%2B%2FFRHnvD99m%2B4za2tn5pRB6AME%2FQVnig2YcsRglLpdk%3D)
2026-03-28 11:07:14 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818427/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc0c10>
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818292%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818292/600 saved to cache
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:14 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:14 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:14 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:14 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b27d0>
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811894%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811894/600 saved to cache
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4f6d0>
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:14 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGR55ULB%252F698818265%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818265/600 saved to cache
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item caf399da-ba62-5f8c-8c9c-a7254fd592b8
2026-03-28 11:07:14 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: caf399da-ba62-5f8c-8c9c-a7254fd592b8, skipping ID generation
2026-03-28 11:07:14 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item caf399da-ba62-5f8c-8c9c-a7254fd592b8 sending to next pipeline
2026-03-28 11:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: caf399da-ba62-5f8c-8c9c-a7254fd592b8, identifier: GR55%20ULB
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3153d0>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811868%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811868/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: caf399da-ba62-5f8c-8c9c-a7254fd592b8 with identifier: GR55%20ULB
2026-03-28 11:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: caf399da-ba62-5f8c-8c9c-a7254fd592b8 with identifier: GR55%20ULB
2026-03-28 11:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: caf399da-ba62-5f8c-8c9c-a7254fd592b8 with identifier: GR55%20ULB to the API
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818265/600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_expert_report_file_181e4237-3d60-4007-b536-7a2ec7ba27e2.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GR55%20ULB-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'caf399da-ba62-5f8c-8c9c-a7254fd592b8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GR55 ULB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GR55%20ULB&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 86242,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45352,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818243/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45276,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818265/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44662,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43755,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44549,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818328/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818341/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 100516,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818372/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66685,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77485,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818419/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_caf399da-ba62-5f8c-8c9c-a7254fd592b8/caf399da-ba62-5f8c-8c9c-a7254fd592b8_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GR55ULB/698818442/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I T3 Hatchback',
'transmission': 'manual',
'trim': 'VVT-I T3',
'vin': 'VNKKL18380A214482',
'year': 2005}
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR55%2520ULB%27 HTTP/1.1" 200 None
2026-03-28 11:07:15 [bca.uk] INFO: Saving data for GR55%20ULB: {'created_time': 1774696035.412305, 'last_price_update_time': 1774696035.412317, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GR55%2520ULB') HTTP/1.1" 204 0
2026-03-28 11:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811749/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KP69DTN/42807914?sv=2020-08-04&st=2026-03-28T11%3A07%3A06Z&se=2026-03-28T11%3A32%3A06Z&sr=b&sp=r&sig=LPDlhGA68RUXK6Gi%2FTUSarFlCIrif43Hsg4ujer8JGY%3D)
2026-03-28 11:07:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818241>
2026-03-28 11:07:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649657/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649657>
2026-03-28 11:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818255/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796842>
2026-03-28 11:07:15 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698649629>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc62590>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798191%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798191/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2e650>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798305%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798305/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4cb10>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811914%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811914/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf47d0>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811775%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811775/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e899f90>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811839%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811839/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0c650>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FML11YCS%252F698798280%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798280/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b24e560b-d815-5611-8097-f663470ed43b
2026-03-28 11:07:15 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b24e560b-d815-5611-8097-f663470ed43b, skipping ID generation
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b24e560b-d815-5611-8097-f663470ed43b sending to next pipeline
2026-03-28 11:07:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b24e560b-d815-5611-8097-f663470ed43b, identifier: ML11%20YCS
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:15 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc8fd0>
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:15 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818427%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818427/600 saved to cache
2026-03-28 11:07:15 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b24e560b-d815-5611-8097-f663470ed43b with identifier: ML11%20YCS
2026-03-28 11:07:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b24e560b-d815-5611-8097-f663470ed43b with identifier: ML11%20YCS
2026-03-28 11:07:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b24e560b-d815-5611-8097-f663470ed43b with identifier: ML11%20YCS to the API
2026-03-28 11:07:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798280/600>
{'auction_title': '',
'c_o_2_emission_value': 137,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_expert_report_file_3529c1db-4a5c-483f-acbf-d0859704cb78.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=ML11%20YCS-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b24e560b-d815-5611-8097-f663470ed43b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'ML11 YCS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=ML11%20YCS&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 162978,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43771,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798178/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44550,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44936,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798214/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45209,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798235/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41597,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40151,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798262/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88590,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798280/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64753,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77924,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b24e560b-d815-5611-8097-f663470ed43b/b24e560b-d815-5611-8097-f663470ed43b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80502,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/ML11YCS/698798338/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.5 DCI 110 N-TEC Hatchback',
'transmission': 'manual',
'trim': 'DCI 110 N-TEC',
'vin': 'SJNFCAJ10U2290613',
'year': 2011}
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML11%2520YCS%27 HTTP/1.1" 200 None
2026-03-28 11:07:16 [bca.uk] INFO: Saving data for ML11%20YCS: {'created_time': 1774696036.190351, 'last_price_update_time': 1774696036.190362, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='ML11%2520YCS') HTTP/1.1" 204 0
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814050/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814050>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796812/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796812>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818100/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818100>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296322/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KM66FHL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF66%20WCL-GB>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA17%20TWN-GB>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK10%20VKV-GB>
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad1763d0>
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811749%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811749/600 saved to cache
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd1c750>
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKP69DTN%252F698811738%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811738/600 saved to cache
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 64370ae9-ee70-5b55-bab3-19bba1b36cad
2026-03-28 11:07:16 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 64370ae9-ee70-5b55-bab3-19bba1b36cad, skipping ID generation
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 64370ae9-ee70-5b55-bab3-19bba1b36cad sending to next pipeline
2026-03-28 11:07:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 64370ae9-ee70-5b55-bab3-19bba1b36cad, identifier: KP69%20DTN
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad1764d0>
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818278%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818278/600 saved to cache
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a9790>
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:16 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818255%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818255/600 saved to cache
2026-03-28 11:07:16 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN
2026-03-28 11:07:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN
2026-03-28 11:07:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 64370ae9-ee70-5b55-bab3-19bba1b36cad with identifier: KP69%20DTN to the API
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811738/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_expert_report_file_f4212057-cfe7-4de0-89e3-d20cb4c84039.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP69%20DTN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '64370ae9-ee70-5b55-bab3-19bba1b36cad',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP69 DTN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP69%20DTN&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 80382,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43325,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811749/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44640,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811762/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42828,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811775/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42567,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811788/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42077,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811839/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86066,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811868/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811894/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_64370ae9-ee70-5b55-bab3-19bba1b36cad/64370ae9-ee70-5b55-bab3-19bba1b36cad_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 107360,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KP69DTN/698811914/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 150 R LINE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 150 R LINE DSG',
'vin': 'WVWZZZAUZLW006264',
'year': 2019}
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520DTN%27 HTTP/1.1" 200 None
2026-03-28 11:07:16 [bca.uk] INFO: Saving data for KP69%20DTN: {'created_time': 1774696036.948292, 'last_price_update_time': 1774696036.948303, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP69%2520DTN') HTTP/1.1" 204 0
2026-03-28 11:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF66%20DZV-GB>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM03%20CCZ-GB>
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796781/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796781>
2026-03-28 11:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD66EUB/42808154?sv=2020-08-04&st=2026-03-28T11%3A07%3A05Z&se=2026-03-28T11%3A32%3A05Z&sr=b&sp=r&sig=cYXkiwufFozXfijStFAyuh2%2Bvt9ZZBwkTE1vWXYzjEA%3D)
2026-03-28 11:07:16 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB17%20HFF-GB>
2026-03-28 11:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649657/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM14HWD/42805478?sv=2020-08-04&st=2026-03-28T11%3A07%3A04Z&se=2026-03-28T11%3A32%3A04Z&sr=b&sp=r&sig=19rueHJmuIswiVT6ZLSQI3jhcvc%2FMlvEuFpymGHPnGg%3D)
2026-03-28 11:07:17 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817988>
2026-03-28 11:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296322/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KM66FHL/42797329?sv=2020-08-04&st=2026-03-28T11%3A05%3A46Z&se=2026-03-28T11%3A30%3A46Z&sr=b&sp=r&sig=36w9DldJDp5%2FRRJXL4pIMrA9SqU1hM972r3kszMYgQ8%3D)
2026-03-28 11:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796812/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814050/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8b4d0>
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649629%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649629/600 saved to cache
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818100/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bcf50>
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD66EUB%252F698818241%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818241/600 saved to cache
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2
2026-03-28 11:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 79920aac-a0d8-5e9e-8565-6a33b873ebb2, skipping ID generation
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 79920aac-a0d8-5e9e-8565-6a33b873ebb2 sending to next pipeline
2026-03-28 11:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 79920aac-a0d8-5e9e-8565-6a33b873ebb2, identifier: BD66%20EUB
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8bc290>
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796842%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796842/600 saved to cache
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:17 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea77950>
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:17 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM14HWD%252F698649657%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649657/600 saved to cache
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0c61e304-7d9e-5e1f-8212-e5585370b47b
2026-03-28 11:07:17 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0c61e304-7d9e-5e1f-8212-e5585370b47b, skipping ID generation
2026-03-28 11:07:17 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0c61e304-7d9e-5e1f-8212-e5585370b47b sending to next pipeline
2026-03-28 11:07:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0c61e304-7d9e-5e1f-8212-e5585370b47b, identifier: KM14%20HWD
2026-03-28 11:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 79920aac-a0d8-5e9e-8565-6a33b873ebb2 with identifier: BD66%20EUB
2026-03-28 11:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 79920aac-a0d8-5e9e-8565-6a33b873ebb2 with identifier: BD66%20EUB
2026-03-28 11:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 79920aac-a0d8-5e9e-8565-6a33b873ebb2 with identifier: BD66%20EUB to the API
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818241/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_expert_report_file_af49ad95-d18b-467f-af02-ab5ba906decc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD66%20EUB-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '79920aac-a0d8-5e9e-8565-6a33b873ebb2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD66 EUB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD66%20EUB&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 59560,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44746,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818224/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43035,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818255/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45467,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818296/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818319/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 101379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818376/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82925,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818402/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_79920aac-a0d8-5e9e-8565-6a33b873ebb2/79920aac-a0d8-5e9e-8565-6a33b873ebb2_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD66EUB/698818427/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 MPI 75 COLOUR EDITION Hatchback',
'transmission': 'manual',
'trim': 'MPI 75 COLOUR EDITION',
'vin': 'TMBFB6NJ2HZ068266',
'year': 2016}
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD66%2520EUB%27 HTTP/1.1" 200 None
2026-03-28 11:07:17 [bca.uk] INFO: Saving data for BD66%20EUB: {'created_time': 1774696037.858715, 'last_price_update_time': 1774696037.858725, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD66%2520EUB') HTTP/1.1" 204 0
2026-03-28 11:07:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD
2026-03-28 11:07:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD
2026-03-28 11:07:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0c61e304-7d9e-5e1f-8212-e5585370b47b with identifier: KM14%20HWD to the API
2026-03-28 11:07:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649657/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_expert_report_file_977ded88-ff73-4da6-b0d9-64c7e3bd7758.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM14%20HWD-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '0c61e304-7d9e-5e1f-8212-e5585370b47b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM14 HWD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM14%20HWD&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'BMW',
'model': '520D',
'odometer': 125207,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41508,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649471/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649487/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45848,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649498/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43147,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649513/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40027,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649528/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649542/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87333,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649577/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91739,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649629/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0c61e304-7d9e-5e1f-8212-e5585370b47b/0c61e304-7d9e-5e1f-8212-e5585370b47b_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86477,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM14HWD/698649657/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 M SPORT TOURING STEP Estate',
'transmission': 'automatic',
'trim': 'M SPORT TOURING STEP',
'vin': 'WBA5J32000D340899',
'year': 2014}
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM14%2520HWD%27 HTTP/1.1" 200 None
2026-03-28 11:07:18 [bca.uk] INFO: Saving data for KM14%20HWD: {'created_time': 1774696038.266527, 'last_price_update_time': 1774696038.266538, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM14%2520HWD') HTTP/1.1" 204 0
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796781/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX15%20VFY-GB>
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac09c990>
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKM66FHL%252F698296322%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296322/600 saved to cache
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c1dbde14-933f-5ed8-827d-25216bd45d38
2026-03-28 11:07:18 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c1dbde14-933f-5ed8-827d-25216bd45d38, skipping ID generation
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c1dbde14-933f-5ed8-827d-25216bd45d38 sending to next pipeline
2026-03-28 11:07:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c1dbde14-933f-5ed8-827d-25216bd45d38, identifier: KM66%20FHL
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2a5d0>
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796812%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796812/600 saved to cache
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b8610>
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698814050%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814050/600 saved to cache
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:18 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae46f910>
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818100%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818100/600 saved to cache
2026-03-28 11:07:18 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL
2026-03-28 11:07:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL
2026-03-28 11:07:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c1dbde14-933f-5ed8-827d-25216bd45d38 with identifier: KM66%20FHL to the API
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296322/600>
{'auction_title': '',
'c_o_2_emission_value': 85,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_expert_report_file_9b899e2a-ba34-4a58-bced-2de108a87cd4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KM66%20FHL-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c1dbde14-933f-5ed8-827d-25216bd45d38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KM66 FHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KM66%20FHL&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 158425,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42622,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296322/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44182,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296332/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44531,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45736,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296352/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296357/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296368/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 98576,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296378/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296393/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96313,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296408/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c1dbde14-933f-5ed8-827d-25216bd45d38/c1dbde14-933f-5ed8-827d-25216bd45d38_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 97653,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KM66FHL/698296423/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 BLUEHDI 120 ACTIVE Estate',
'transmission': 'manual',
'trim': 'BLUEHDI 120 ACTIVE',
'vin': 'VF3LCBHZHGS146335',
'year': 2016}
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM66%2520FHL%27 HTTP/1.1" 200 None
2026-03-28 11:07:18 [bca.uk] INFO: Saving data for KM66%20FHL: {'created_time': 1774696038.944477, 'last_price_update_time': 1774696038.944487, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KM66%2520FHL') HTTP/1.1" 204 0
2026-03-28 11:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817962/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817962>
2026-03-28 11:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796769/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796769>
2026-03-28 11:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20BZP-GB>
2026-03-28 11:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF66%20URS-GB>
2026-03-28 11:07:18 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:18 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN02%20DLN-GB>
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9f1b90>
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:18 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:18 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_expert_report_file_8a36d272-c1dc-42b1-ba58-ea2412fbe6fe.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a800e5a3-78c5-59ad-aee5-5985ded6f596, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFA17TWN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FA17TWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce1c50>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_expert_report_file_7a2a65e7-fa0d-4865-8866-4bee2b203e32.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffab2477-4674-596a-86bc-d7450140eaf9, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWF66WCL-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WF66WCL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcb1690>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796781%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796781/600 saved to cache
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce2610>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_expert_report_file_b6ba7e7c-4e0a-4c90-b8da-2106e582a013.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DPF66DZV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF66DZV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e89b690>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_expert_report_file_e1a9db63-2999-4a24-b451-9e48ef22716e.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFM03CCZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FM03CCZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9a8210>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_expert_report_file_05185ec4-b139-4550-97ff-00dff568e965.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3432e69a-fc31-5aa0-a769-766a4874750d, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 9 photos for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEK10VKV-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK10VKV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e281dd0>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_expert_report_file_d5ab8a08-cb61-4fe2-9929-427e1a463720.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 427eeecf-7f92-56d7-881b-e7294fabcb41, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLB17HFF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LB17HFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817940/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817940>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818004/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818004>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN66%20TXZ-GB>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796759/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796759>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698813988/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FR62KCZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT13%20WRU-GB>
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794248%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794248 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698781993%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781993 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516241%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516241 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765203%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765203 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787694%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787694 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690540%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690540 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebad750>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698817988%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817988/600 saved to cache
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794257%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794257 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782008%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782008 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516251%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516251 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765229%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765229 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787707%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787707 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690550%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690550 not downloaded yet
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817962/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817969/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817969>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796750/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796750>
2026-03-28 11:07:19 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817921/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD62NNR-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796769/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794264%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794264 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782026%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782026 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516266%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516266 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765261%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765261 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787716%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787716 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690567%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690567 not downloaded yet
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794272%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794272 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782054%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782054 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516278%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516278 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765292%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765292 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787726%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787726 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690582%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690582 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdf6250>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_expert_report_file_94ed0591-d60a-4912-9561-2aca90a3c652.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55ea19b8-9abe-5537-af8c-51406928956c, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DEF66URS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF66URS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796759/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818004/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698813988/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FR62KCZ/42807931?sv=2020-08-04&st=2026-03-28T11%3A05%3A44Z&se=2026-03-28T11%3A30%3A44Z&sr=b&sp=r&sig=7wA0rRoD9OLOkFTcHTvn%2Bd5o55A6wU2fg6dRbo67UNI%3D)
2026-03-28 11:07:19 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817940/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794285%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794285 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782077%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782077 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516290%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516290 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765305%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765305 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787738%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787738 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690592%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690592 not downloaded yet
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296193%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296193 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea744d0>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_expert_report_file_87df6f90-1fbf-4765-83b5-d0be82f3bfdd.pdf HTTP/1.1" 201 0
2026-03-28 11:07:19 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:19 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75bdd3e7-038e-5007-9137-32beb11d671f, skipping ID generation
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFX15VFY-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FX15VFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e2923d0>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698817962%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817962/600 saved to cache
2026-03-28 11:07:19 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4a250>
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:19 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:19 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796769%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796769/600 saved to cache
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690540/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690540>
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794295%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794295 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782109%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782109 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516299%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516299 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765332%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765332 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787756%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787756 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690615%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690615 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296196%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296196 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912752%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912752 not downloaded yet
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e877690>
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_expert_report_file_e42732a7-96f3-402b-9052-817f3b46eb6f.pdf HTTP/1.1" 201 0
2026-03-28 11:07:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b0df2fc-e1e2-543c-aac0-0c570961652c, skipping ID generation
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DFY65BZP-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY65BZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796750/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817921/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD62NNR/42808503?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=bPHJfnwLq4MR9mu2qXq%2FFaCe%2BSRYLXiaGD%2Bi%2B87JEq4%3D)
2026-03-28 11:07:20 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817969/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690550>
2026-03-28 11:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787707>
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794308%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794308 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782141%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782141 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516310%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516310 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765370%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765370 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787768%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787768 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690634%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690634 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296199%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296199 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912771%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912771 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774802%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774802 not downloaded yet
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e60b5d0>
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_expert_report_file_d4b37a0d-8719-4eee-b5f6-3b7af54a2ab9.pdf HTTP/1.1" 201 0
2026-03-28 11:07:20 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63, skipping ID generation
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBN02DLN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BN02DLN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95b2d0>
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796759%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796759/600 saved to cache
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e56a890>
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698818004%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818004/600 saved to cache
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac116610>
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFR62KCZ%252F698813988%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698813988/600 saved to cache
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d
2026-03-28 11:07:20 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 060f8cd0-4649-57d3-b26d-21ea2185aa7d, skipping ID generation
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 060f8cd0-4649-57d3-b26d-21ea2185aa7d sending to next pipeline
2026-03-28 11:07:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 060f8cd0-4649-57d3-b26d-21ea2185aa7d, identifier: FR62%20KCZ
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b4b90>
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:20 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698817940%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817940/600 saved to cache
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765229/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765229>
2026-03-28 11:07:20 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690567/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690567>
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794318%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794318 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782180%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782180 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516326%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516326 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765399%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765399 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698787780%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787780 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690656%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690656 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296200%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296200 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912791%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912791 not downloaded yet
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774823%27 HTTP/1.1" 200 None
2026-03-28 11:07:20 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774823 not downloaded yet
2026-03-28 11:07:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ
2026-03-28 11:07:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ
2026-03-28 11:07:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 060f8cd0-4649-57d3-b26d-21ea2185aa7d with identifier: FR62%20KCZ to the API
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698813988/600>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_expert_report_file_ebbb64b9-b206-4a12-be61-d70d3d373822.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FR62%20KCZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '060f8cd0-4649-57d3-b26d-21ea2185aa7d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FR62 KCZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FR62%20KCZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLKSWAGEN',
'model': 'JETTA',
'odometer': 151818,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43880,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698813988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42768,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814001/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44011,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814015/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814035/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41199,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814050/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39757,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814071/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814108/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 68790,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814144/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814176/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_060f8cd0-4649-57d3-b26d-21ea2185aa7d/060f8cd0-4649-57d3-b26d-21ea2185aa7d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FR62KCZ/698814208/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN JETTA 1.6 TDI CR 105 BMT S DSG Saloon',
'transmission': 'automatic',
'trim': 'TDI CR 105 BMT S DSG',
'vin': 'WVWZZZ16ZDM034265',
'year': 2013}
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR62%2520KCZ%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [bca.uk] INFO: Saving data for FR62%20KCZ: {'created_time': 1774696041.294507, 'last_price_update_time': 1774696041.294518, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FR62%2520KCZ') HTTP/1.1" 204 0
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511533%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511533 not downloaded yet
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e299f90>
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_expert_report_file_d50d2e72-9c6b-49d9-b2ec-d420f8856213.pdf HTTP/1.1" 201 0
2026-03-28 11:07:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 560ed465-d714-5f9f-9fcb-eeca023ff2cc, skipping ID generation
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLT13WRU-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT13WRU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac516050>
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_expert_report_file_6a42f13d-05bb-423f-892a-9a10eeab1b46.pdf HTTP/1.1" 201 0
2026-03-28 11:07:21 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09e16d97-cf19-589c-9507-63ba990dd971, skipping ID generation
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DSN66TXZ-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SN66TXZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc2a0d0>
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796750%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796750/600 saved to cache
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac183210>
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD62NNR%252F698817921%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817921/600 saved to cache
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac
2026-03-28 11:07:21 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac, skipping ID generation
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac sending to next pipeline
2026-03-28 11:07:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac, identifier: LD62%20NNR
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcb0390>
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:21 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698817969%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817969/600 saved to cache
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516278/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516278>
2026-03-28 11:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787726/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787726>
2026-03-28 11:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690582/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690582>
2026-03-28 11:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765292>
2026-03-28 11:07:21 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296191/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EF66URS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:21 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690540/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698794333%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794333 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698782213%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782213 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698516338%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516338 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698765436%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765436 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698690672%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690672 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296205%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296205 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912807%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912807 not downloaded yet
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774852%27 HTTP/1.1" 200 None
2026-03-28 11:07:21 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774852 not downloaded yet
2026-03-28 11:07:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR
2026-03-28 11:07:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR
2026-03-28 11:07:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac with identifier: LD62%20NNR to the API
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817921/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_expert_report_file_b494ec4b-7f58-4282-8a68-88e6d8680ca8.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD62%20NNR-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD62 NNR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD62%20NNR&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 169471,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47240,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817921/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817940/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817962/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45012,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698817988/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43462,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818009/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42514,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818036/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 95913,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818063/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78742,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818088/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85813,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818112/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac/c7fb3d0b-bfee-5cc2-b63f-e1f8a681beac_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD62NNR/698818137/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.6 TDI 105 MATCH Hatchback',
'transmission': 'manual',
'trim': 'TDI 105 MATCH',
'vin': 'WVWZZZ1KZDP029210',
'year': 2012}
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520NNR%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [bca.uk] INFO: Saving data for LD62%20NNR: {'created_time': 1774696042.312128, 'last_price_update_time': 1774696042.312138, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD62%2520NNR') HTTP/1.1" 204 0
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511541%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511541 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774806%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774806 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822409%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822409 not downloaded yet
2026-03-28 11:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912745/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FX15VFY-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296210%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296210 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912827%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912827 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774889%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774889 not downloaded yet
2026-03-28 11:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296196/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296196>
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511550%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511550 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774834%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774834 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822429%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822429 not downloaded yet
2026-03-28 11:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912752/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912752>
2026-03-28 11:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690615>
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690567/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774786/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FY65BZP-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296215%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296215 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912869%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912869 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774907%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774907 not downloaded yet
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac316350>
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690540%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690540/600 saved to cache
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765229/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511556%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511556 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774857%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774857 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822452%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822452 not downloaded yet
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296191/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296221%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296221 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912899%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912899 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774936%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774936 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511563%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511563 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774876%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774876 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822470%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822470 not downloaded yet
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690582/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774823>
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698296227%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296227 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912928%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912928 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774970%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774970 not downloaded yet
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296196/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912745/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511574%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511574 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774892%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774892 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822490%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822490 not downloaded yet
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787726/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:22 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516278/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698912954%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912954 not downloaded yet
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775005%27 HTTP/1.1" 200 None
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775005 not downloaded yet
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc60710>
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690567%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690567/600 saved to cache
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fed90>
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690550%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690550/600 saved to cache
2026-03-28 11:07:22 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac317310>
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:22 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:22 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787707%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787707/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2cfe50>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765229%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765229/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac241e50>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296191%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296191/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774786/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912752/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774889/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774889>
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511588%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511588 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774926%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774926 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822524%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822524 not downloaded yet
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775029%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775029 not downloaded yet
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac410990>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690582%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690582/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4a410>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765292%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765292/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511602%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511602 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774953%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774953 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822547%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822547 not downloaded yet
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822452/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822452>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822429/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822429>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912827/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912827>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774834/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774834>
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D693511615%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511615 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698774987%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774987 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822572%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822572 not downloaded yet
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4758d0>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296196%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296196/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae7882d0>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912745%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912745/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8b7d0>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787726%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787726/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac249410>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516278%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516278/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac115f10>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774786%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774786/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4ed10>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912752%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912752/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774970/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774970>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774936/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774936>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912899/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912899>
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698775015%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775015 not downloaded yet
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698822597%27 HTTP/1.1" 200 None
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822597 not downloaded yet
2026-03-28 11:07:23 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:23 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:23 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:23 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea4650>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690615%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690615/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296227/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296227>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822470/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822470>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912928/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912928>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcbf2d0>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774823%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774823/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774889/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822490/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822490>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912954/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912954>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775005/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775005>
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774834/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912827/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822452/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822429/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822572>
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912928/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912899/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822470/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774970/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe84710>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774889%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774889/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774936/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822597/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822597>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe6150>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774834%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774834/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8234d0>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912827%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912827/600 saved to cache
2026-03-28 11:07:23 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698775015/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775015>
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775005/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:23 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822490/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774987/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774987>
2026-03-28 11:07:23 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511615/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511615>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e28a850>
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:23 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822452%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822452/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912954/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e4390>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822429%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822429/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac5379d0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912928%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912928/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffdba90>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912899%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912899/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2f7790>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822470%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822470/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b7cd0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774970%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774970/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac5363d0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774936%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774936/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822547/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822547>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774953/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774953>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511602>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775029/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698775029>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822524/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822524>
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac40f510>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698775005%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775005/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4ba6d0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822490%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822490/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac40d310>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912954%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912954/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774926/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774926>
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2cf510>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822572%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822572/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511588/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511588>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774892/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774892>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511574/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511574>
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822597/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774987/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511615/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774953/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698775015/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822547/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775029/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce5f90>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822597%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822597/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774876/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774876>
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822524/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511588/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe9b1d0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774987%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774987/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774892/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774926/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511574/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc29850>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511615%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511615/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac248bd0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774953%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774953/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea899d0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698775015%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698775015/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511556/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511556>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296221/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296221>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774907/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774907>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774857/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774857>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511563/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511563>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912869/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912869>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296215/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296215>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774806/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774806>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822409/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698822409>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296210/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296210>
2026-03-28 11:07:24 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511550/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511550>
2026-03-28 11:07:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774876/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac248a50>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822547%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822547/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac314b10>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698775029%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775029/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e613ed0>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511602%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511602/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdab050>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822524%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822524/600 saved to cache
2026-03-28 11:07:24 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:24 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ad150>
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:24 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511588%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511588/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd30510>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774892%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774892/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa2490>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774926%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774926/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd30550>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511574%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511574/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296227/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2f08d0>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774876%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774876/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774852/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774852>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511541/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511541>
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296221/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774907/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511563/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511556/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511550/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2479d0>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296227%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296227/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774857/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822409/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912807/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912807>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296205/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296205>
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912869/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5fc910>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296221%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296221/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296215/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774806/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296210/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4120d0>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774907%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774907/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4b9e90>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511563%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511563/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4cad0>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511556%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511556/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2e590>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511550%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511550/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774852/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690672/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690672>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765436/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765436>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516338/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516338>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782213/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782213>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794333/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794333>
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511541/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4d290>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774857%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774857/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac32b110>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822409%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822409/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea88e50>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912869%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912869/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fecb410>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296215%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296215/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea8b350>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774806%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774806/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:25 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e282b50>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296210%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296210/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912807/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296205/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912791/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912791>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296200/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296200>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690656/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690656>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511533/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=693511533>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774784/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LT13WRU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822381/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SN66TXZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff7ef50>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774852%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774852/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8f010>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511541%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511541/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822381/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SN66TXZ/42797229?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=LRN0fZ%2F1UeNfSPPp%2Fw8Q%2BGS1ck%2FdkIRxCLRv9KbFOzQ%3D)
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787780/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787780>
2026-03-28 11:07:25 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765399/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765399>
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782213/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690672/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2ddd0>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912807%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912807/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765436/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516338/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2f710>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296205%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296205/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690656/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774784/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LT13WRU/42807603?sv=2020-08-04&st=2026-03-28T11%3A07%3A19Z&se=2026-03-28T11%3A32%3A19Z&sr=b&sp=r&sig=1DRKgOokscoMaU2Y8vVLt0OitKATcuX1M6CVkpA5rg4%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794333/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:25 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912791/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff7f110>
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:25 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSN66TXZ%252F698822381%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822381/600 saved to cache
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 09e16d97-cf19-589c-9507-63ba990dd971
2026-03-28 11:07:25 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 09e16d97-cf19-589c-9507-63ba990dd971, skipping ID generation
2026-03-28 11:07:25 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 09e16d97-cf19-589c-9507-63ba990dd971 sending to next pipeline
2026-03-28 11:07:26 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 09e16d97-cf19-589c-9507-63ba990dd971, identifier: SN66%20TXZ
2026-03-28 11:07:26 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ
2026-03-28 11:07:26 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ
2026-03-28 11:07:26 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 09e16d97-cf19-589c-9507-63ba990dd971 with identifier: SN66%20TXZ to the API
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:26 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822381/600>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_expert_report_file_6a42f13d-05bb-423f-892a-9a10eeab1b46.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SN66%20TXZ-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '09e16d97-cf19-589c-9507-63ba990dd971',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SN66 TXZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SN66%20TXZ&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'CAPTUR',
'odometer': 47081,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45103,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822381/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43970,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822409/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42201,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822429/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44607,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822452/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822470/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41112,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822490/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87301,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822524/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70010,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822547/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79195,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_09e16d97-cf19-589c-9507-63ba990dd971/09e16d97-cf19-589c-9507-63ba990dd971_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78779,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SN66TXZ/698822597/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT CAPTUR 1.5 DCI 90 DYNAMIQUE S Hatchback',
'transmission': 'manual',
'trim': 'DCI 90 DYNAMIQUE S',
'vin': 'VF12RAJ1A56141327',
'year': 2016}
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520TXZ%27 HTTP/1.1" 200 None
2026-03-28 11:07:26 [bca.uk] INFO: Saving data for SN66%20TXZ: {'created_time': 1774696046.832708, 'last_price_update_time': 1774696046.83272, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SN66%2520TXZ') HTTP/1.1" 204 0
2026-03-28 11:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511533/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296200/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516326>
2026-03-28 11:07:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782180>
2026-03-28 11:07:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794318>
2026-03-28 11:07:26 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511527/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BN02DLN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765399/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787780/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e412650>
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782213%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782213/600 saved to cache
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa0450>
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690672%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690672/600 saved to cache
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fdab050>
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765436%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765436/600 saved to cache
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac16b090>
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516338%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516338/600 saved to cache
2026-03-28 11:07:26 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:26 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a7dd0>
2026-03-28 11:07:26 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690656%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690656/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff49dd0>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLT13WRU%252F698774784%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774784/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc
2026-03-28 11:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 560ed465-d714-5f9f-9fcb-eeca023ff2cc, skipping ID generation
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 560ed465-d714-5f9f-9fcb-eeca023ff2cc sending to next pipeline
2026-03-28 11:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 560ed465-d714-5f9f-9fcb-eeca023ff2cc, identifier: LT13%20WRU
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94aedb3ad0>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794333%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794333/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa1cd0>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912791%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912791/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 560ed465-d714-5f9f-9fcb-eeca023ff2cc with identifier: LT13%20WRU
2026-03-28 11:07:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 560ed465-d714-5f9f-9fcb-eeca023ff2cc with identifier: LT13%20WRU
2026-03-28 11:07:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 560ed465-d714-5f9f-9fcb-eeca023ff2cc with identifier: LT13%20WRU to the API
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774784/600>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_expert_report_file_d50d2e72-9c6b-49d9-b2ec-d420f8856213.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LT13%20WRU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '560ed465-d714-5f9f-9fcb-eeca023ff2cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LT13 WRU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LT13%20WRU&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'BMW',
'model': '520D',
'odometer': 135907,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 51377,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774784/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50415,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774806/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774834/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47854,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774857/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43963,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774876/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42366,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774892/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75216,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774926/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72588,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774953/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88482,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698774987/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_560ed465-d714-5f9f-9fcb-eeca023ff2cc/560ed465-d714-5f9f-9fcb-eeca023ff2cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LT13WRU/698775015/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'BMW 520D 2.0 M SPORT STEP S/S Saloon',
'transmission': 'manual',
'trim': 'M SPORT STEP S/S',
'vin': 'WBAFW12080D274919',
'year': 2013}
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT13%2520WRU%27 HTTP/1.1" 200 None
2026-03-28 11:07:27 [bca.uk] INFO: Saving data for LT13%20WRU: {'created_time': 1774696047.679144, 'last_price_update_time': 1774696047.679156, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LT13%2520WRU') HTTP/1.1" 204 0
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774802/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698774802>
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787768/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787768>
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765370/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765370>
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690634/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690634>
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296199/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296199>
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912771/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698912771>
2026-03-28 11:07:27 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511527/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BN02DLN/42705703?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=K9YT06lOeF2S4u%2FVis30zOD0iemtMc%2BMvx1GbYZ0glo%3D)
2026-03-28 11:07:27 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516310/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516310>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2a4950>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511533%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511533/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd06310>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296200%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296200/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:27 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b1350>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765399%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765399/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad319210>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787780%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787780/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe787d0>
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:27 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBN02DLN%252F693511527%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511527/600 saved to cache
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63
2026-03-28 11:07:27 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63, skipping ID generation
2026-03-28 11:07:27 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 07fe67d1-d6b7-52bf-9732-2bbbc048ea63 sending to next pipeline
2026-03-28 11:07:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63, identifier: BN02%20DLN
2026-03-28 11:07:28 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63 with identifier: BN02%20DLN
2026-03-28 11:07:28 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63 with identifier: BN02%20DLN
2026-03-28 11:07:28 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07fe67d1-d6b7-52bf-9732-2bbbc048ea63 with identifier: BN02%20DLN to the API
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:28 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511527/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_expert_report_file_d4b37a0d-8719-4eee-b5f6-3b7af54a2ab9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN02%20DLN-GB',
'category': 'Car',
'color': 'multicoloured',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '07fe67d1-d6b7-52bf-9732-2bbbc048ea63',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BN02 DLN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN02%20DLN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'RENAULT',
'model': 'GRAND SCENIC',
'odometer': 45908,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46447,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511527/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511533/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511541/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46890,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46380,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511556/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43947,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511563/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70536,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511574/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75256,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511588/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88076,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_07fe67d1-d6b7-52bf-9732-2bbbc048ea63/07fe67d1-d6b7-52bf-9732-2bbbc048ea63_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BN02DLN/693511615/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'RENAULT GRAND SCENIC 1.6 DCI 130 DYNAMIQUE MPV',
'transmission': 'manual',
'trim': 'DCI 130 DYNAMIQUE',
'vin': 'VF1RFA00156033703',
'year': 2016}
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN02%2520DLN%27 HTTP/1.1" 200 None
2026-03-28 11:07:28 [bca.uk] INFO: Saving data for BN02%20DLN: {'created_time': 1774696048.378265, 'last_price_update_time': 1774696048.378276, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN02%2520DLN') HTTP/1.1" 204 0
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794308/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794308>
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782141/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782141>
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787756/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787756>
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765332>
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516310/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516299/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516299>
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912771/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FX15VFY/42809581?sv=2020-08-04&st=2026-03-28T11%3A07%3A17Z&se=2026-03-28T11%3A32%3A17Z&sr=b&sp=r&sig=Fhz0bBPio8XPzsxWu6aEHiP%2BQxuBaNxDN3JpEm1%2FjIw%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774802/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FY65BZP/42807549?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=JABOyyxAznO84%2BOp%2Bbnvu7eakbKOoCA4mG%2FPBLjpqH8%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765370/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb90890>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782180%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782180/600 saved to cache
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690634/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296199/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:28 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e99d0>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794318%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794318/600 saved to cache
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782141/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787768/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782109/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782109>
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794295/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794295>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eac37d0>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516326%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516326/600 saved to cache
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc0cd0>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516310%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516310/600 saved to cache
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:28 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794308/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296193/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698296193>
2026-03-28 11:07:28 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698690592>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac316e90>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFX15VFY%252F698912771%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912771/600 saved to cache
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 75bdd3e7-038e-5007-9137-32beb11d671f
2026-03-28 11:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 75bdd3e7-038e-5007-9137-32beb11d671f, skipping ID generation
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 75bdd3e7-038e-5007-9137-32beb11d671f sending to next pipeline
2026-03-28 11:07:28 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 75bdd3e7-038e-5007-9137-32beb11d671f, identifier: FX15%20VFY
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac317b10>
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:28 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFY65BZP%252F698774802%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774802/600 saved to cache
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 0b0df2fc-e1e2-543c-aac0-0c570961652c
2026-03-28 11:07:28 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 0b0df2fc-e1e2-543c-aac0-0c570961652c, skipping ID generation
2026-03-28 11:07:28 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 0b0df2fc-e1e2-543c-aac0-0c570961652c sending to next pipeline
2026-03-28 11:07:29 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0b0df2fc-e1e2-543c-aac0-0c570961652c, identifier: FY65%20BZP
2026-03-28 11:07:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787756/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765305/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765305>
2026-03-28 11:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516290/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516290>
2026-03-28 11:07:29 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787738/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787738>
2026-03-28 11:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 75bdd3e7-038e-5007-9137-32beb11d671f with identifier: FX15%20VFY
2026-03-28 11:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 75bdd3e7-038e-5007-9137-32beb11d671f with identifier: FX15%20VFY
2026-03-28 11:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 75bdd3e7-038e-5007-9137-32beb11d671f with identifier: FX15%20VFY to the API
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912771/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_expert_report_file_87df6f90-1fbf-4765-83b5-d0be82f3bfdd.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FX15%20VFY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '75bdd3e7-038e-5007-9137-32beb11d671f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FX15 VFY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FX15%20VFY&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 81251,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47855,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912745/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46286,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912752/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912771/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44749,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912791/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44436,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912807/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43585,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912827/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 86069,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912869/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 56319,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912899/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79073,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912928/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_75bdd3e7-038e-5007-9137-32beb11d671f/75bdd3e7-038e-5007-9137-32beb11d671f_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 69833,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FX15VFY/698912954/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'NLHB351BLGZ041985',
'year': 2015}
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX15%2520VFY%27 HTTP/1.1" 200 None
2026-03-28 11:07:29 [bca.uk] INFO: Saving data for FX15%20VFY: {'created_time': 1774696049.400871, 'last_price_update_time': 1774696049.400884, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FX15%2520VFY') HTTP/1.1" 204 0
2026-03-28 11:07:29 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0b0df2fc-e1e2-543c-aac0-0c570961652c with identifier: FY65%20BZP
2026-03-28 11:07:29 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0b0df2fc-e1e2-543c-aac0-0c570961652c with identifier: FY65%20BZP
2026-03-28 11:07:29 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0b0df2fc-e1e2-543c-aac0-0c570961652c with identifier: FY65%20BZP to the API
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:29 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774802/600>
{'auction_title': '',
'c_o_2_emission_value': 110,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_expert_report_file_e42732a7-96f3-402b-9052-817f3b46eb6f.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FY65%20BZP-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0b0df2fc-e1e2-543c-aac0-0c570961652c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FY65 BZP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FY65%20BZP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FIAT',
'model': '500',
'odometer': 47397,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45676,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774786/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774802/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43946,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44059,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774852/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42959,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774889/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41696,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774907/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 89682,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774936/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698774970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70062,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775005/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_0b0df2fc-e1e2-543c-aac0-0c570961652c/0b0df2fc-e1e2-543c-aac0-0c570961652c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66368,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FY65BZP/698775029/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 POP Hatchback',
'transmission': 'manual',
'trim': 'POP',
'vin': 'ZFA3120000J475288',
'year': 2015}
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520BZP%27 HTTP/1.1" 200 None
2026-03-28 11:07:29 [bca.uk] INFO: Saving data for FY65%20BZP: {'created_time': 1774696049.820508, 'last_price_update_time': 1774696049.820522, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FY65%2520BZP') HTTP/1.1" 204 0
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac317010>
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765332%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765332/600 saved to cache
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd32150>
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765370%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765370/600 saved to cache
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa2fd0>
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690634%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690634/600 saved to cache
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac115810>
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296199%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296199/600 saved to cache
2026-03-28 11:07:29 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:29 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcc2e50>
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:29 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:29 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782141%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782141/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e28add0>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787768%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787768/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516299/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794285/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794285>
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782077/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782077>
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782054/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782054>
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc41d0>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794308%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794308/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc5310>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787756%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787756/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794272/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794272>
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787716>
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794295/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae491d10>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516299%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516299/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782109/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765261/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765261>
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765305/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787738/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516266/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516266>
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe35f10>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794295%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794295/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296193/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EF66URS/42797603?sv=2020-08-04&st=2026-03-28T11%3A07%3A18Z&se=2026-03-28T11%3A32%3A18Z&sr=b&sp=r&sig=IqH4ip9mMeeRbqqpkd%2FreZ1KkiuAXVVEim95CVmNMGE%3D)
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782077/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782026/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782026>
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782054/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:30 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac536f90>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782109%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782109/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794285/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516290/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4e4d0>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765305%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765305/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e962250>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690592%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690592/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794272/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516251/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516251>
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794264/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794264>
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782008/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698782008>
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765261/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:30 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794257/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794257>
2026-03-28 11:07:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe7950>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787738%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787738/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac279390>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEF66URS%252F698296193%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296193/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 55ea19b8-9abe-5537-af8c-51406928956c
2026-03-28 11:07:30 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 55ea19b8-9abe-5537-af8c-51406928956c, skipping ID generation
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 55ea19b8-9abe-5537-af8c-51406928956c sending to next pipeline
2026-03-28 11:07:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 55ea19b8-9abe-5537-af8c-51406928956c, identifier: EF66%20URS
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae449690>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782077%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782077/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc9afd0>
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:30 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782054%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782054/600 saved to cache
2026-03-28 11:07:30 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 55ea19b8-9abe-5537-af8c-51406928956c with identifier: EF66%20URS
2026-03-28 11:07:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 55ea19b8-9abe-5537-af8c-51406928956c with identifier: EF66%20URS
2026-03-28 11:07:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 55ea19b8-9abe-5537-af8c-51406928956c with identifier: EF66%20URS to the API
2026-03-28 11:07:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296193/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_expert_report_file_94ed0591-d60a-4912-9561-2aca90a3c652.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EF66%20URS-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '55ea19b8-9abe-5537-af8c-51406928956c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EF66 URS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EF66%20URS&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'HYUNDAI',
'model': 'I20',
'odometer': 47679,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43269,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296191/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44776,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296193/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45153,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296196/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44568,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296199/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42551,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296200/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42409,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296205/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88555,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296210/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61171,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296215/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296221/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_55ea19b8-9abe-5537-af8c-51406928956c/55ea19b8-9abe-5537-af8c-51406928956c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EF66URS/698296227/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'HYUNDAI I20 1.2 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'NLHB351BLHZ260491',
'year': 2016}
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF66%2520URS%27 HTTP/1.1" 200 None
2026-03-28 11:07:31 [bca.uk] INFO: Saving data for EF66%20URS: {'created_time': 1774696051.40345, 'last_price_update_time': 1774696051.403462, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EF66%2520URS') HTTP/1.1" 204 0
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787694/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787694>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765203/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698765203>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781993/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698781993>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516241/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698516241>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794248/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698794248>
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782026/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690522/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LB17HFF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516266/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2474d0>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794285%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794285/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fce5090>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516290%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516290/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95b090>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794272%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794272/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b9850>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765261%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765261/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95b5d0>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787716%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787716/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794257/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782008/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787683/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=EK10VKV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765180/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FM03CCZ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794264/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516251/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8f4c50>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782026%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782026/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b7e10>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516266%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516266/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=PF66DZV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794248/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf6310>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794257%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794257/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc62d10>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698782008%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782008/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765203/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690522/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LB17HFF/42805885?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=nRdqPqKWJcli2epZ%2Be4B76t27aN208gjBt8yCiGNE78%3D)
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781974/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WF66WCL-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781993/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765180/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FM03CCZ/42807498?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=GZpEfmtLjK3yf2oGJLXhn8G0Lb2q4jkq3CpuSzYGxY4%3D)
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794240/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=FA17TWN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe54b90>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794264%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794264/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23ca90>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516251%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516251/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac297e90>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794248%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794248/600 saved to cache
2026-03-28 11:07:31 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA17%20CVN-GB>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817942/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698817942>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796739/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698796739>
2026-03-28 11:07:31 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NS16%20AHS-GB>
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787694/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516241/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/PF66DZV/42801966?sv=2020-08-04&st=2026-03-28T11%3A07%3A16Z&se=2026-03-28T11%3A32%3A16Z&sr=b&sp=r&sig=K8wq8tcQISIk2FoOjbVWZlN%2BQMkLQx2UzP8jfrznY5g%3D)
2026-03-28 11:07:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787683/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/EK10VKV/42807956?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=qyz4XYzQ69G9MSS09837juhEGlHiFoCO761I2L8m3kQ%3D)
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4e550>
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:31 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:31 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765203%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765203/600 saved to cache
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff63e50>
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLB17HFF%252F698690522%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690522/600 saved to cache
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 427eeecf-7f92-56d7-881b-e7294fabcb41
2026-03-28 11:07:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 427eeecf-7f92-56d7-881b-e7294fabcb41, skipping ID generation
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 427eeecf-7f92-56d7-881b-e7294fabcb41 sending to next pipeline
2026-03-28 11:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 427eeecf-7f92-56d7-881b-e7294fabcb41, identifier: LB17%20HFF
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad31b990>
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698781993%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781993/600 saved to cache
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e95a850>
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:32 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFM03CCZ%252F698765180%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765180/600 saved to cache
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12
2026-03-28 11:07:32 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12, skipping ID generation
2026-03-28 11:07:32 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 sending to next pipeline
2026-03-28 11:07:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12, identifier: FM03%20CCZ
2026-03-28 11:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 427eeecf-7f92-56d7-881b-e7294fabcb41 with identifier: LB17%20HFF
2026-03-28 11:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 427eeecf-7f92-56d7-881b-e7294fabcb41 with identifier: LB17%20HFF
2026-03-28 11:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 427eeecf-7f92-56d7-881b-e7294fabcb41 with identifier: LB17%20HFF to the API
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690522/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_expert_report_file_d5ab8a08-cb61-4fe2-9929-427e1a463720.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LB17%20HFF-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '427eeecf-7f92-56d7-881b-e7294fabcb41',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LB17 HFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LB17%20HFF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VOLVO',
'model': 'XC60',
'odometer': 57842,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47290,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690522/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48013,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690540/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690550/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48524,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690567/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46398,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690582/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45134,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91083,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690615/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77423,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690634/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 91633,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690656/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_427eeecf-7f92-56d7-881b-e7294fabcb41/427eeecf-7f92-56d7-881b-e7294fabcb41_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71947,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LB17HFF/698690672/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VOLVO XC60 2.4 D4 190 AWD R DESIGN LUX G/T Estate',
'transmission': 'manual',
'trim': 'D4 190 AWD R DESIGN LUX G/T',
'vin': 'YV1DZA5C6H2185158',
'year': 2017}
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB17%2520HFF%27 HTTP/1.1" 200 None
2026-03-28 11:07:32 [bca.uk] INFO: Saving data for LB17%20HFF: {'created_time': 1774696052.784588, 'last_price_update_time': 1774696052.784601, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LB17%2520HFF') HTTP/1.1" 204 0
2026-03-28 11:07:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ
2026-03-28 11:07:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ
2026-03-28 11:07:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 60d1c3a6-a68e-5644-8bbe-75d64cacdc12 with identifier: FM03%20CCZ to the API
2026-03-28 11:07:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765180/600>
{'auction_title': '',
'c_o_2_emission_value': 150,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_expert_report_file_e1a9db63-2999-4a24-b451-9e48ef22716e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FM03%20CCZ-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.3L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '60d1c3a6-a68e-5644-8bbe-75d64cacdc12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FM03 CCZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FM03%20CCZ&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 90470,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47395,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46318,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765203/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45312,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765229/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46047,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765261/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45142,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765305/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83148,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765332/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67998,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765370/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74532,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765399/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_60d1c3a6-a68e-5644-8bbe-75d64cacdc12/60d1c3a6-a68e-5644-8bbe-75d64cacdc12_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66951,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FM03CCZ/698765436/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2003-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.3 VVT-I T SPIRIT Hatchback',
'transmission': 'automatic',
'trim': 'VVT-I T SPIRIT',
'vin': 'VNKKL18390A054774',
'year': 2003}
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM03%2520CCZ%27 HTTP/1.1" 200 None
2026-03-28 11:07:33 [bca.uk] INFO: Saving data for FM03%20CCZ: {'created_time': 1774696053.172776, 'last_price_update_time': 1774696053.172788, 'auction_closing_time': 1775037600.0}
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FM03%2520CCZ') HTTP/1.1" 204 0
2026-03-28 11:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781974/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WF66WCL/42807198?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=hfFGazaaFa7q8TEgwqztm80AkmQnfM5CnwKz9hszy1Q%3D)
2026-03-28 11:07:33 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794240/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/FA17TWN/42808019?sv=2020-08-04&st=2026-03-28T11%3A07%3A15Z&se=2026-03-28T11%3A32%3A15Z&sr=b&sp=r&sig=s58ifYhe9iYgzok9HJ1XUjsNvV%2FXePKDCxX7M4269%2Bs%3D)
2026-03-28 11:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817925/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YG10VAH-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796730/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=GY64VCN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786283/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698786283>
2026-03-28 11:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411959/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698411959>
2026-03-28 11:07:33 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO18%20YOD-GB>
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae612ad0>
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787694%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787694/600 saved to cache
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8f9d0>
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516241%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516241/600 saved to cache
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc62a10>
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FPF66DZV%252F698516228%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516228/600 saved to cache
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea
2026-03-28 11:07:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea, skipping ID generation
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea sending to next pipeline
2026-03-28 11:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea, identifier: PF66%20DZV
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc60150>
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:33 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FEK10VKV%252F698787683%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787683/600 saved to cache
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3432e69a-fc31-5aa0-a769-766a4874750d
2026-03-28 11:07:33 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3432e69a-fc31-5aa0-a769-766a4874750d, skipping ID generation
2026-03-28 11:07:33 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3432e69a-fc31-5aa0-a769-766a4874750d sending to next pipeline
2026-03-28 11:07:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3432e69a-fc31-5aa0-a769-766a4874750d, identifier: EK10%20VKV
2026-03-28 11:07:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV
2026-03-28 11:07:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV
2026-03-28 11:07:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7a9750db-a0d5-5087-b9f8-ed3e178eb3ea with identifier: PF66%20DZV to the API
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516228/600>
{'auction_title': '',
'c_o_2_emission_value': 229,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_expert_report_file_b6ba7e7c-4e0a-4c90-b8da-2106e582a013.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF66%20DZV-GB',
'category': 'LightCommercialVehicle',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '7a9750db-a0d5-5087-b9f8-ed3e178eb3ea',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF66 DZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF66%20DZV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'RELAY 35 HD',
'odometer': 112445,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 26,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 139767,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 149378,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516241/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 128875,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516251/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 136529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516266/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516278/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174596,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516290/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174401,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516299/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172068,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516310/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 172727,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_7a9750db-a0d5-5087-b9f8-ed3e178eb3ea/7a9750db-a0d5-5087-b9f8-ed3e178eb3ea_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 205609,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/PF66DZV/698516338/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'CITROEN RELAY 35 HD 2.2 HDI 130 L4 H2 PanelVan',
'transmission': 'manual',
'trim': 'HDI 130 L4 H2',
'vin': 'VF7YDUMAU12B06819',
'year': 2016}
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF66%2520DZV%27 HTTP/1.1" 200 None
2026-03-28 11:07:34 [bca.uk] INFO: Saving data for PF66%20DZV: {'created_time': 1774696054.013752, 'last_price_update_time': 1774696054.013762, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF66%2520DZV') HTTP/1.1" 204 0
2026-03-28 11:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3432e69a-fc31-5aa0-a769-766a4874750d with identifier: EK10%20VKV
2026-03-28 11:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3432e69a-fc31-5aa0-a769-766a4874750d with identifier: EK10%20VKV
2026-03-28 11:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3432e69a-fc31-5aa0-a769-766a4874750d with identifier: EK10%20VKV to the API
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:34 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787683/600>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_expert_report_file_05185ec4-b139-4550-97ff-00dff568e965.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK10%20VKV-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3432e69a-fc31-5aa0-a769-766a4874750d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK10 VKV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK10%20VKV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 190350,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 193140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787683/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 204793,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787694/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 214982,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 230465,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787716/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 177838,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787726/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152621,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787738/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158869,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787756/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 179968,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787768/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3432e69a-fc31-5aa0-a769-766a4874750d/3432e69a-fc31-5aa0-a769-766a4874750d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 182777,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/EK10VKV/698787780/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.6 TDCI 110 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TDCI 110 TITANIUM',
'vin': 'WF0PXXWPDPAS44688',
'year': 2010}
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK10%2520VKV%27 HTTP/1.1" 200 None
2026-03-28 11:07:34 [bca.uk] INFO: Saving data for EK10%20VKV: {'created_time': 1774696054.457667, 'last_price_update_time': 1774696054.457679, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK10%2520VKV') HTTP/1.1" 204 0
2026-03-28 11:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907412>
2026-03-28 11:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817942/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796739/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906828/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906828>
2026-03-28 11:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906825/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906825>
2026-03-28 11:07:34 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907400/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907400>
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd30c90>
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWF66WCL%252F698781974%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781974/600 saved to cache
2026-03-28 11:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item ffab2477-4674-596a-86bc-d7450140eaf9
2026-03-28 11:07:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: ffab2477-4674-596a-86bc-d7450140eaf9, skipping ID generation
2026-03-28 11:07:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item ffab2477-4674-596a-86bc-d7450140eaf9 sending to next pipeline
2026-03-28 11:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ffab2477-4674-596a-86bc-d7450140eaf9, identifier: WF66%20WCL
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fffa810>
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:34 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FFA17TWN%252F698794240%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794240/600 saved to cache
2026-03-28 11:07:34 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a800e5a3-78c5-59ad-aee5-5985ded6f596
2026-03-28 11:07:34 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a800e5a3-78c5-59ad-aee5-5985ded6f596, skipping ID generation
2026-03-28 11:07:34 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a800e5a3-78c5-59ad-aee5-5985ded6f596 sending to next pipeline
2026-03-28 11:07:34 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a800e5a3-78c5-59ad-aee5-5985ded6f596, identifier: FA17%20TWN
2026-03-28 11:07:34 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:34 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL
2026-03-28 11:07:34 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL
2026-03-28 11:07:34 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ffab2477-4674-596a-86bc-d7450140eaf9 with identifier: WF66%20WCL to the API
2026-03-28 11:07:34 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781974/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_expert_report_file_7a2a65e7-fa0d-4865-8866-4bee2b203e32.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WF66%20WCL-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'ffab2477-4674-596a-86bc-d7450140eaf9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WF66 WCL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WF66%20WCL&vehicleType=*',
'listing': 'auction',
'location': 'Measham',
'make': 'MERCEDES-BENZ',
'model': 'C250 D',
'odometer': 101230,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41695,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781974/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40643,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698781993/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42835,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782008/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41499,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782026/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782054/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40525,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782077/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50357,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782109/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 57291,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782141/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70371,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782180/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_ffab2477-4674-596a-86bc-d7450140eaf9/ffab2477-4674-596a-86bc-d7450140eaf9_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 72988,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WF66WCL/698782213/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ C250 D 2.1 AMG LINE Saloon',
'transmission': 'manual',
'trim': 'AMG LINE',
'vin': 'WDD2050082R233791',
'year': 2016}
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF66%2520WCL%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [bca.uk] INFO: Saving data for WF66%20WCL: {'created_time': 1774696055.119779, 'last_price_update_time': 1774696055.11979, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WF66%2520WCL') HTTP/1.1" 204 0
2026-03-28 11:07:35 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN
2026-03-28 11:07:35 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN
2026-03-28 11:07:35 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a800e5a3-78c5-59ad-aee5-5985ded6f596 with identifier: FA17%20TWN to the API
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:35 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794240/600>
{'auction_title': '',
'c_o_2_emission_value': 112,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_expert_report_file_8a36d272-c1dc-42b1-ba58-ea2412fbe6fe.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FA17%20TWN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a800e5a3-78c5-59ad-aee5-5985ded6f596',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FA17 TWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FA17%20TWN&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'E200 D',
'odometer': 56438,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 52139,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794240/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794248/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48051,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794257/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49238,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794264/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794272/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43429,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794285/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77424,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794295/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78704,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794308/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81231,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a800e5a3-78c5-59ad-aee5-5985ded6f596/a800e5a3-78c5-59ad-aee5-5985ded6f596_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87053,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/FA17TWN/698794333/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ E200 D 2.0 AMG LINE 9G Saloon',
'transmission': 'manual',
'trim': 'AMG LINE 9G',
'vin': 'WDD2130132A284041',
'year': 2017}
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA17%2520TWN%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [bca.uk] INFO: Saving data for FA17%20TWN: {'created_time': 1774696055.548441, 'last_price_update_time': 1774696055.548453, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FA17%2520TWN') HTTP/1.1" 204 0
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796730/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GY64VCN/42808067?sv=2020-08-04&st=2026-03-28T11%3A05%3A41Z&se=2026-03-28T11%3A30%3A41Z&sr=b&sp=r&sig=WQawEonPk8YAj3BmWwDpbja0aEp2D%2Bgk1cCdQ0vq0GE%3D)
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411959/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817925/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YG10VAH/42808504?sv=2020-08-04&st=2026-03-28T11%3A05%3A42Z&se=2026-03-28T11%3A30%3A42Z&sr=b&sp=r&sig=jnpkglP9Y6PRkEQHLONWwsnG9vSbEZ%2FAOAP5PsricxI%3D)
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786283/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:07:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786252/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WN68XXC-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411949/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NK17UZV-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea48c10>
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_expert_report_file_ec47aedb-797e-470b-8679-9d6812f9f558.pdf HTTP/1.1" 201 0
2026-03-28 11:07:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9295467-dc05-5a7c-8170-d45a3e57c067, skipping ID generation
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNS16AHS-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NS16AHS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8b9010>
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698817942%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817942/600 saved to cache
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb18d10>
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796739%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796739/600 saved to cache
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0e110>
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_expert_report_file_7a61b0c1-325b-4ddb-a583-f3c2a04c23a4.pdf HTTP/1.1" 201 0
2026-03-28 11:07:35 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc26d888-e1c0-5316-bed2-e9f8b9e59c12, skipping ID generation
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DMA17CVN-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA17CVN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907400/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:07:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798716/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798716>
2026-03-28 11:07:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907392/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698907392>
2026-03-28 11:07:35 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906823/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698906823>
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752731%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752731 not downloaded yet
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387146%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387146 not downloaded yet
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906825/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:07:35 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906828/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752758%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752758 not downloaded yet
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387158%27 HTTP/1.1" 200 None
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387158 not downloaded yet
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff3ec10>
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:35 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGY64VCN%252F698796730%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796730/600 saved to cache
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a810a8a8-d5e9-52db-8f4f-157b36d1163d
2026-03-28 11:07:35 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a810a8a8-d5e9-52db-8f4f-157b36d1163d, skipping ID generation
2026-03-28 11:07:35 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a810a8a8-d5e9-52db-8f4f-157b36d1163d sending to next pipeline
2026-03-28 11:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a810a8a8-d5e9-52db-8f4f-157b36d1163d, identifier: GY64%20VCN
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd33e50>
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411959%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411959/600 saved to cache
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff61750>
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYG10VAH%252F698817925%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817925/600 saved to cache
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 8045aeca-0321-548f-849f-0212d3ae522c
2026-03-28 11:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8045aeca-0321-548f-849f-0212d3ae522c, skipping ID generation
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8045aeca-0321-548f-849f-0212d3ae522c sending to next pipeline
2026-03-28 11:07:36 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8045aeca-0321-548f-849f-0212d3ae522c, identifier: YG10%20VAH
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b7790>
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786283%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786283/600 saved to cache
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac18e990>
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:36 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_expert_report_file_4ea98ed2-1516-44ea-88fe-18fbe9a5f181.pdf HTTP/1.1" 201 0
2026-03-28 11:07:36 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:36 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87e614a2-94ae-5d47-88c5-1096d8457081, skipping ID generation
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DWO18YOD-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WO18YOD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:36 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818374/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=SY63BZU-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752789%27 HTTP/1.1" 200 None
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752789 not downloaded yet
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387166%27 HTTP/1.1" 200 None
2026-03-28 11:07:36 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387166 not downloaded yet
2026-03-28 11:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN
2026-03-28 11:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN
2026-03-28 11:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a810a8a8-d5e9-52db-8f4f-157b36d1163d with identifier: GY64%20VCN to the API
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:36 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796730/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_expert_report_file_fdeda8f1-38b5-44c4-ad09-60048656dd4a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GY64%20VCN-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a810a8a8-d5e9-52db-8f4f-157b36d1163d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GY64 VCN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GY64%20VCN&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'TOYOTA',
'model': 'RAV4',
'odometer': 114888,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48907,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796730/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48356,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796739/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45336,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796750/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45949,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796759/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44425,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796769/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42264,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796781/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92064,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796796/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 67084,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796812/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77154,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a810a8a8-d5e9-52db-8f4f-157b36d1163d/a810a8a8-d5e9-52db-8f4f-157b36d1163d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81028,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GY64VCN/698796862/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'TOYOTA RAV4 2.2 D 148 ICON 4WD StationWagon',
'transmission': 'manual',
'trim': 'D 148 ICON 4WD',
'vin': 'JTMRCREV50D061098',
'year': 2014}
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY64%2520VCN%27 HTTP/1.1" 200 None
2026-03-28 11:07:36 [bca.uk] INFO: Saving data for GY64%20VCN: {'created_time': 1774696056.766733, 'last_price_update_time': 1774696056.766746, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GY64%2520VCN') HTTP/1.1" 204 0
2026-03-28 11:07:36 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8045aeca-0321-548f-849f-0212d3ae522c with identifier: YG10%20VAH
2026-03-28 11:07:36 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8045aeca-0321-548f-849f-0212d3ae522c with identifier: YG10%20VAH
2026-03-28 11:07:36 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8045aeca-0321-548f-849f-0212d3ae522c with identifier: YG10%20VAH to the API
2026-03-28 11:07:36 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:37 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817925/600>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_expert_report_file_5c4c7940-b947-49f6-8fc3-d9e2bd4f2971.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YG10%20VAH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8045aeca-0321-548f-849f-0212d3ae522c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YG10 VAH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YG10%20VAH&vehicleType=*',
'listing': 'auction',
'location': 'Birmingham - Perry Barr',
'make': 'BMW',
'model': '320D',
'odometer': 147564,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49487,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817925/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817942/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698817969/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46341,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818004/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45135,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818025/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44217,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818047/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 85158,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818072/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80504,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818100/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 81634,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818129/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8045aeca-0321-548f-849f-0212d3ae522c/8045aeca-0321-548f-849f-0212d3ae522c_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80123,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YG10VAH/698818156/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'BMW 320D 2.0 EFFICIENTDYNAMICS Saloon',
'transmission': 'manual',
'trim': 'EFFICIENTDYNAMICS',
'vin': 'WBAPP52020A790994',
'year': 2010}
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG10%2520VAH%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [bca.uk] INFO: Saving data for YG10%20VAH: {'created_time': 1774696057.192487, 'last_price_update_time': 1774696057.192498, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YG10%2520VAH') HTTP/1.1" 204 0
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411949/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NK17UZV/42799458?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=fmavXMl3jaF9XEHmaZ1WU328cl%2BeVapPCvT4KObkDO0%3D)
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786252/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN68XXC/42807892?sv=2020-08-04&st=2026-03-28T11%3A02%3A23Z&se=2026-03-28T11%3A27%3A23Z&sr=b&sp=r&sig=Iny70FZYOa5GEm3160iV3YOE8Xp4D9Dj9tVTWACuUj0%3D)
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798677/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798677>
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ18%20YDM-GB>
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814276%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814276 not downloaded yet
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798649/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798649>
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798681/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798681>
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752818%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752818 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387175%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387175 not downloaded yet
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814292%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814292 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752842%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752842 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387185%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387185 not downloaded yet
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e822fd0>
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907400%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907400/600 saved to cache
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e627e90>
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906825%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906825/600 saved to cache
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5c2cd0>
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906828%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906828/600 saved to cache
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814313%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814313 not downloaded yet
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814332/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814332>
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387137/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=MA17CVN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387146/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387146>
2026-03-28 11:07:37 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752731>
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798716/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752875%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752875 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387204%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387204 not downloaded yet
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906823/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SL07BVB/42809427?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=3mxyS1qgrAJ8ir2ZTcJR0DYtoyDbuwQcKZ3pD6WH6RU%3D)
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814329%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814329 not downloaded yet
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907392/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/GU09BHP/42809433?sv=2020-08-04&st=2026-03-28T11%3A02%3A22Z&se=2026-03-28T11%3A27%3A22Z&sr=b&sp=r&sig=w7Lo4DLNcZlPZqXI2k2hzlw7iKZSH9SpQIDbQ%2FP2Jjg%3D)
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752906%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752906 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387228%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387228 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814344%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814344 not downloaded yet
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff3e210>
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNK17UZV%252F698411949%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411949/600 saved to cache
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3902049c-7c47-5636-bbb3-3468c754f44d
2026-03-28 11:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3902049c-7c47-5636-bbb3-3468c754f44d, skipping ID generation
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3902049c-7c47-5636-bbb3-3468c754f44d sending to next pipeline
2026-03-28 11:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3902049c-7c47-5636-bbb3-3468c754f44d, identifier: NK17%20UZV
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc7050>
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN68XXC%252F698786252%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786252/600 saved to cache
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 80b8c73c-e33d-5f05-b1b8-6f3101793112
2026-03-28 11:07:37 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 80b8c73c-e33d-5f05-b1b8-6f3101793112, skipping ID generation
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 80b8c73c-e33d-5f05-b1b8-6f3101793112 sending to next pipeline
2026-03-28 11:07:37 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 80b8c73c-e33d-5f05-b1b8-6f3101793112, identifier: WN68%20XXC
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff3dd10>
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:37 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907412%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907412/600 saved to cache
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:07:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818374/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/SY63BZU/42808482?sv=2020-08-04&st=2026-03-28T11%3A01%3A22Z&se=2026-03-28T11%3A26%3A22Z&sr=b&sp=r&sig=LlsOSbfKIKjSKJCEN78xvAhc3w7ylaq7WfCAciHM4Gk%3D)
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752933%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752933 not downloaded yet
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387247%27 HTTP/1.1" 200 None
2026-03-28 11:07:37 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387247 not downloaded yet
2026-03-28 11:07:37 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV
2026-03-28 11:07:37 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV
2026-03-28 11:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3902049c-7c47-5636-bbb3-3468c754f44d with identifier: NK17%20UZV to the API
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411949/600>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_expert_report_file_40bfee53-c0cf-4883-b4ea-8ce4d39ff0e9.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NK17%20UZV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '3902049c-7c47-5636-bbb3-3468c754f44d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NK17 UZV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NK17%20UZV&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'CITROEN',
'model': 'C3',
'odometer': 37495,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45464,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411949/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43922,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411952/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41136,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411959/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41973,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411965/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41036,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411970/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40379,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411973/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411978/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 60261,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411984/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73661,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411990/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3902049c-7c47-5636-bbb3-3468c754f44d/3902049c-7c47-5636-bbb3-3468c754f44d_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70989,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NK17UZV/698411997/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 BLUEHDI 100 FLAIR S/S Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 100 FLAIR S/S',
'vin': 'VF7SXBHY6GT561444',
'year': 2017}
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK17%2520UZV%27 HTTP/1.1" 200 None
2026-03-28 11:07:38 [bca.uk] INFO: Saving data for NK17%20UZV: {'created_time': 1774696058.340666, 'last_price_update_time': 1774696058.340679, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NK17%2520UZV') HTTP/1.1" 204 0
2026-03-28 11:07:38 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 80b8c73c-e33d-5f05-b1b8-6f3101793112 with identifier: WN68%20XXC
2026-03-28 11:07:38 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 80b8c73c-e33d-5f05-b1b8-6f3101793112 with identifier: WN68%20XXC
2026-03-28 11:07:38 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 80b8c73c-e33d-5f05-b1b8-6f3101793112 with identifier: WN68%20XXC to the API
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:38 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786252/600>
{'auction_title': '',
'c_o_2_emission_value': 117,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_expert_report_file_9b59233c-976e-451c-bb0d-069127e2e5eb.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN68%20XXC-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '80b8c73c-e33d-5f05-b1b8-6f3101793112',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN68 XXC',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN68%20XXC&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'HYUNDAI',
'model': 'I10',
'odometer': 72772,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49348,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786252/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48239,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786267/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45716,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786283/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45991,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786299/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786321/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43941,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786334/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 92190,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786353/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 66718,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786377/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78428,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786401/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_80b8c73c-e33d-5f05-b1b8-6f3101793112/80b8c73c-e33d-5f05-b1b8-6f3101793112_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73847,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN68XXC/698786420/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'HYUNDAI I10 1.0 SE Hatchback',
'transmission': 'manual',
'trim': 'SE',
'vin': 'NLHA851ALKZ485555',
'year': 2018}
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN68%2520XXC%27 HTTP/1.1" 200 None
2026-03-28 11:07:38 [bca.uk] INFO: Saving data for WN68%20XXC: {'created_time': 1774696058.723529, 'last_price_update_time': 1774696058.723544, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN68%2520XXC') HTTP/1.1" 204 0
2026-03-28 11:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798677/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D)
2026-03-28 11:07:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387158/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387158>
2026-03-28 11:07:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814270/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=WO18YOD-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798681/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN54DZL/42808137?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=qf0jPnBs9kEZx0kCISPWyAnTF5%2FHmUBTBzEUSHUjgwM%3D)
2026-03-28 11:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798649/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK05KCN/42808014?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=gANA8pybdk4x89IPcI7C6tEJdd9J09Ln4zVAzOu53iI%3D)
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814382%27 HTTP/1.1" 200 None
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814382 not downloaded yet
2026-03-28 11:07:38 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:38 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387175/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387175>
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698752965%27 HTTP/1.1" 200 None
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752965 not downloaded yet
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D697387262%27 HTTP/1.1" 200 None
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387262 not downloaded yet
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814414%27 HTTP/1.1" 200 None
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814414 not downloaded yet
2026-03-28 11:07:38 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:38 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:38 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:38 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:38 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae627ad0>
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798716%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798716/600 saved to cache
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc8bd10>
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:38 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSL07BVB%252F698906823%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906823/600 saved to cache
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 965bc451-0889-5f8d-976c-d99f3e039949
2026-03-28 11:07:38 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 965bc451-0889-5f8d-976c-d99f3e039949, skipping ID generation
2026-03-28 11:07:38 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 965bc451-0889-5f8d-976c-d99f3e039949 sending to next pipeline
2026-03-28 11:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 965bc451-0889-5f8d-976c-d99f3e039949, identifier: SL07%20BVB
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1ec50>
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FGU09BHP%252F698907392%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907392/600 saved to cache
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a
2026-03-28 11:07:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: c7cf4ba2-074e-565a-8e3d-b27be7a9586a, skipping ID generation
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item c7cf4ba2-074e-565a-8e3d-b27be7a9586a sending to next pipeline
2026-03-28 11:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c7cf4ba2-074e-565a-8e3d-b27be7a9586a, identifier: GU09%20BHP
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5cdc50>
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:39 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_168964c4-009e-5f86-a5de-a609e726f9b5/168964c4-009e-5f86-a5de-a609e726f9b5_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FSY63BZU%252F698818374%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818374/600 saved to cache
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 168964c4-009e-5f86-a5de-a609e726f9b5
2026-03-28 11:07:39 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 168964c4-009e-5f86-a5de-a609e726f9b5, skipping ID generation
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 168964c4-009e-5f86-a5de-a609e726f9b5 sending to next pipeline
2026-03-28 11:07:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 168964c4-009e-5f86-a5de-a609e726f9b5, identifier: SY63%20BZU
2026-03-28 11:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387137/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:39 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814443%27 HTTP/1.1" 200 None
2026-03-28 11:07:39 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814443 not downloaded yet
2026-03-28 11:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 965bc451-0889-5f8d-976c-d99f3e039949 with identifier: SL07%20BVB
2026-03-28 11:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 965bc451-0889-5f8d-976c-d99f3e039949 with identifier: SL07%20BVB
2026-03-28 11:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 965bc451-0889-5f8d-976c-d99f3e039949 with identifier: SL07%20BVB to the API
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:39 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906823/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_expert_report_file_8c392565-4849-4593-9050-431ad55d4c02.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SL07%20BVB-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '965bc451-0889-5f8d-976c-d99f3e039949',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SL07 BVB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SL07%20BVB&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MINI',
'model': 'COOPER',
'odometer': 91745,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 168639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 175546,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906821/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 161584,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906823/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 157858,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906825/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 152887,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906828/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 148258,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906830/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 156950,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906833/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 174442,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906835/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_965bc451-0889-5f8d-976c-d99f3e039949/965bc451-0889-5f8d-976c-d99f3e039949_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 163193,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SL07BVB/698906838/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'MINI COOPER 1.6 Hatchback',
'transmission': 'manual',
'trim': '',
'vin': 'WMWMF32010TT11804',
'year': 2007}
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL07%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 11:07:39 [bca.uk] INFO: Saving data for SL07%20BVB: {'created_time': 1774696059.655732, 'last_price_update_time': 1774696059.655744, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SL07%2520BVB') HTTP/1.1" 204 0
2026-03-28 11:07:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c7cf4ba2-074e-565a-8e3d-b27be7a9586a with identifier: GU09%20BHP
2026-03-28 11:07:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c7cf4ba2-074e-565a-8e3d-b27be7a9586a with identifier: GU09%20BHP
2026-03-28 11:07:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c7cf4ba2-074e-565a-8e3d-b27be7a9586a with identifier: GU09%20BHP to the API
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907392/600>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_expert_report_file_727a3a5a-2210-4d29-97f1-023b5c0ecb96.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU09%20BHP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c7cf4ba2-074e-565a-8e3d-b27be7a9586a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU09 BHP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU09%20BHP&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 163429,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 9,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 197019,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907388/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 178223,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907392/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 184669,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907400/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 196750,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907412/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164849,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907426/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 142615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907441/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 164172,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 158183,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907464/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_c7cf4ba2-074e-565a-8e3d-b27be7a9586a/c7cf4ba2-074e-565a-8e3d-b27be7a9586a_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 166961,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/GU09BHP/698907470/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'TITANIUM',
'vin': 'WF0GXXGAJG8L46696',
'year': 2009}
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU09%2520BHP%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [bca.uk] INFO: Saving data for GU09%20BHP: {'created_time': 1774696060.039291, 'last_price_update_time': 1774696060.039302, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU09%2520BHP') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU
2026-03-28 11:07:40 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU
2026-03-28 11:07:40 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 168964c4-009e-5f86-a5de-a609e726f9b5 with identifier: SY63%20BZU to the API
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818374/600>
{'auction_title': '',
'c_o_2_emission_value': 125,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168964c4-009e-5f86-a5de-a609e726f9b5/168964c4-009e-5f86-a5de-a609e726f9b5_expert_report_file_2c91661d-7fab-40bc-9139-9fb4e426face.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SY63%20BZU-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': '168964c4-009e-5f86-a5de-a609e726f9b5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SY63 BZU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SY63%20BZU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 71780,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_168964c4-009e-5f86-a5de-a609e726f9b5/168964c4-009e-5f86-a5de-a609e726f9b5_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/SY63BZU/698818374/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.2 2 Hatchback',
'transmission': 'automatic',
'trim': '2',
'vin': 'KNABX512MDT549562',
'year': 2013}
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY63%2520BZU%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [bca.uk] INFO: Saving data for SY63%20BZU: {'created_time': 1774696060.43139, 'last_price_update_time': 1774696060.431402, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SY63%2520BZU') HTTP/1.1" 204 0
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387146/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814313/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814313>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387185/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387185>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814329/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814329>
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814270/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814332/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC60AWJ/42808422?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=RQQ4sN7yvoCoEuv1AhH2XXwb0rtF4sUe2LFKtHE6sHE%3D)
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698814475%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814475 not downloaded yet
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe7e50>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD08AYG%252F698798677%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798677/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebd7210>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN54DZL%252F698798681%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798681/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 46d5df6b-48cf-580f-b920-c2fa62de29df
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5c3890>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK05KCN%252F698798649%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798649/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae449cd0>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_expert_report_file_4d5375e3-6012-48f0-b079-b3630ddb2a1a.pdf HTTP/1.1" 201 0
2026-03-28 11:07:40 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:40 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de32900b-a9ba-5cbc-8ed6-8c924f786c60, skipping ID generation
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DNJ18YDM-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ18YDM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387158/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814344/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814344>
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809489%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809489 not downloaded yet
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac16b550>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387137%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387137/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc9ad0>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752731%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752731/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387228/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387228>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752906/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752906>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387247/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387247>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814414/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814414>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387204/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387204>
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809506%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809506 not downloaded yet
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac32aa50>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387146%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387146/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b2ed0>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814270%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814270/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4a8cd0>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC60AWJ%252F698814332%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814332/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387175/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809521%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809521 not downloaded yet
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387262/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387262>
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814329/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809534%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809534 not downloaded yet
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb8bc50>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387158%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387158/600 saved to cache
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814443/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814443>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752965/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752965>
2026-03-28 11:07:40 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814382/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814382>
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809548%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809548 not downloaded yet
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814313/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809572%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809572 not downloaded yet
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814344/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809592%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809592 not downloaded yet
2026-03-28 11:07:40 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387185/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809606%27 HTTP/1.1" 200 None
2026-03-28 11:07:40 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809606 not downloaded yet
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4eed10>
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:40 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:40 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387175%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387175/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NJ18YDM-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387228/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752906/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809506>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387204/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809621%27 HTTP/1.1" 200 None
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809621 not downloaded yet
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae784990>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814329%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814329/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814414/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387247/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f5950>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814313%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814313/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd051d0>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814344%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814344/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae784310>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387185%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387185/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809592/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809592>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809572>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809534/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809534>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809521/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809521>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387262/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814443/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814382/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8e7890>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387228%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387228/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4ab710>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752906%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752906/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff48d50>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387204%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387204/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0d110>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814414%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814414/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff49c10>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387247%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387247/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809606/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809606>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809548/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809548>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752965/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac278310>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387262%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387262/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea61b50>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814443%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814443/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebe7fd0>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814382%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814382/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814475/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814475>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752933/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752933>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809489/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809489>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809592/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809534/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebee8d0>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809506%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809506/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfa710>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809475%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809475/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e983810>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752965%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752965/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809521/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809621/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809621>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752875/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752875>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752842/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752842>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814292/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814292>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752818/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752818>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809548/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809606/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe78550>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809592%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809592/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe4f590>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809572%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809572/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae44b310>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809534%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809534/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814276/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814276>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752789/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752789>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387166/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=697387166>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809489/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752758/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698752758>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752818/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752933/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814475/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e288ed0>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809521%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809521/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd89d0>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809548%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809548/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:41 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ea690>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809606%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809606/600 saved to cache
2026-03-28 11:07:41 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752842/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787506/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787506>
2026-03-28 11:07:41 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752706/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=NS16AHS-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809621/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NJ18YDM/42808162?sv=2020-08-04&st=2026-03-28T11%3A07%3A35Z&se=2026-03-28T11%3A32%3A35Z&sr=b&sp=r&sig=bi0qTLyr4n04ypBMGQH%2B%2FNeYAMQxFASJRT325gETITg%3D)
2026-03-28 11:07:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752875/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ac090>
2026-03-28 11:07:41 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809489%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809489/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b2210>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752818%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752818/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fea4210>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752933%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752933/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e7650>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814475%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814475/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752758/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802709/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802709>
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814292/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818412/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818412>
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802690/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802690>
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752789/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814276/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WO18YOD/42807596?sv=2020-08-04&st=2026-03-28T11%3A07%3A32Z&se=2026-03-28T11%3A32%3A32Z&sr=b&sp=r&sig=6m1%2Btz1O4%2BGb6Zlk1WHV569aO4jhE4hnl9B%2F09r0WOw%3D)
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387166/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/MA17CVN/42779312?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=R4ecz98BDyxeIh%2Bp1X%2Fq0d%2Bj6byWg6XH6mXKArdiUUo%3D)
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe1c890>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752842%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752842/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac356b10>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNJ18YDM%252F698809621%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809621/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item de32900b-a9ba-5cbc-8ed6-8c924f786c60
2026-03-28 11:07:42 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: de32900b-a9ba-5cbc-8ed6-8c924f786c60, skipping ID generation
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item de32900b-a9ba-5cbc-8ed6-8c924f786c60 sending to next pipeline
2026-03-28 11:07:42 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: de32900b-a9ba-5cbc-8ed6-8c924f786c60, identifier: NJ18%20YDM
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:42 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94b7d15e90>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752875%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752875/600 saved to cache
2026-03-28 11:07:42 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:42 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM
2026-03-28 11:07:42 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM
2026-03-28 11:07:42 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: de32900b-a9ba-5cbc-8ed6-8c924f786c60 with identifier: NJ18%20YDM to the API
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:42 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809621/600>
{'auction_title': '',
'c_o_2_emission_value': 127,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_expert_report_file_4d5375e3-6012-48f0-b079-b3630ddb2a1a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NJ18%20YDM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 2,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'de32900b-a9ba-5cbc-8ed6-8c924f786c60',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NJ18 YDM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NJ18%20YDM&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'BMW',
'model': '420D',
'odometer': 76413,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43662,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809475/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45538,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809489/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43942,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809506/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809521/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41185,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809534/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40744,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809548/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62699,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62639,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809592/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 80638,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809606/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_de32900b-a9ba-5cbc-8ed6-8c924f786c60/de32900b-a9ba-5cbc-8ed6-8c924f786c60_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61978,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NJ18YDM/698809621/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'BMW 420D 2.0 190 M SPORT STEP Coupe',
'transmission': 'automatic',
'trim': '190 M SPORT STEP',
'vin': 'WBA4X32050AF29918',
'year': 2018}
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ18%2520YDM%27 HTTP/1.1" 200 None
2026-03-28 11:07:42 [bca.uk] INFO: Saving data for NJ18%20YDM: {'created_time': 1774696062.933874, 'last_price_update_time': 1774696062.933887, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NJ18%2520YDM') HTTP/1.1" 204 0
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752706/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/NS16AHS/42807029?sv=2020-08-04&st=2026-03-28T11%3A07%3A31Z&se=2026-03-28T11%3A32%3A31Z&sr=b&sp=r&sig=Lzpd%2FcmaWkDAkMm9xUPghkeqtVJyfHe3dTAOo46XCQo%3D)
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915692/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915692>
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802731/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802731>
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798670/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798670>
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915669/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915669>
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787506/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW55WSO/42807921?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=ECObaVyd9gRgz05Xmcp%2BESM7xLmJDF9h2X%2FEVj26GEo%3D)
2026-03-28 11:07:42 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798707/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798707>
2026-03-28 11:07:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802690/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae4b0590>
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:42 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752758%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752758/600 saved to cache
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0c610>
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814292%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814292/600 saved to cache
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb5add0>
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752789%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752789/600 saved to cache
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe7ac10>
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWO18YOD%252F698814276%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814276/600 saved to cache
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 87e614a2-94ae-5d47-88c5-1096d8457081
2026-03-28 11:07:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 87e614a2-94ae-5d47-88c5-1096d8457081, skipping ID generation
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 87e614a2-94ae-5d47-88c5-1096d8457081 sending to next pipeline
2026-03-28 11:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87e614a2-94ae-5d47-88c5-1096d8457081, identifier: WO18%20YOD
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5f7ad0>
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:43 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FMA17CVN%252F697387166%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387166/600 saved to cache
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12
2026-03-28 11:07:43 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: dc26d888-e1c0-5316-bed2-e9f8b9e59c12, skipping ID generation
2026-03-28 11:07:43 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item dc26d888-e1c0-5316-bed2-e9f8b9e59c12 sending to next pipeline
2026-03-28 11:07:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dc26d888-e1c0-5316-bed2-e9f8b9e59c12, identifier: MA17%20CVN
2026-03-28 11:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD
2026-03-28 11:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD
2026-03-28 11:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87e614a2-94ae-5d47-88c5-1096d8457081 with identifier: WO18%20YOD to the API
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:43 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814276/600>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_expert_report_file_4ea98ed2-1516-44ea-88fe-18fbe9a5f181.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WO18%20YOD-GB',
'category': 'Car',
'color': 'beige',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '87e614a2-94ae-5d47-88c5-1096d8457081',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WO18 YOD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WO18%20YOD&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'FORD',
'model': 'MONDEO VIGNALE',
'odometer': 23314,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 47780,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814270/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46156,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814276/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814292/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46003,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814313/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814329/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43459,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814344/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84176,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814382/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76725,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814414/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90002,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814443/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_87e614a2-94ae-5d47-88c5-1096d8457081/87e614a2-94ae-5d47-88c5-1096d8457081_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 83093,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WO18YOD/698814475/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD MONDEO VIGNALE 2.0 TDCI 210 P/S Saloon',
'transmission': 'automatic',
'trim': 'TDCI 210 P/S',
'vin': 'WF0DXXWPCDHU39920',
'year': 2018}
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO18%2520YOD%27 HTTP/1.1" 200 None
2026-03-28 11:07:43 [bca.uk] INFO: Saving data for WO18%20YOD: {'created_time': 1774696063.696392, 'last_price_update_time': 1774696063.696402, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WO18%2520YOD') HTTP/1.1" 204 0
2026-03-28 11:07:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dc26d888-e1c0-5316-bed2-e9f8b9e59c12 with identifier: MA17%20CVN
2026-03-28 11:07:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dc26d888-e1c0-5316-bed2-e9f8b9e59c12 with identifier: MA17%20CVN
2026-03-28 11:07:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dc26d888-e1c0-5316-bed2-e9f8b9e59c12 with identifier: MA17%20CVN to the API
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387166/600>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_expert_report_file_7a61b0c1-325b-4ddb-a583-f3c2a04c23a4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA17%20CVN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dc26d888-e1c0-5316-bed2-e9f8b9e59c12',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MA17 CVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA17%20CVN&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 51384,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43030,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387137/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43823,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387146/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41581,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387158/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41222,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387166/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40169,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387175/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40647,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387185/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 76615,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387204/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387228/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 74087,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387247/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_dc26d888-e1c0-5316-bed2-e9f8b9e59c12/dc26d888-e1c0-5316-bed2-e9f8b9e59c12_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 84591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/MA17CVN/697387262/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.2 P/T 110 PERFORMANCE LINE Hatchback',
'transmission': 'manual',
'trim': 'P/T 110 PERFORMANCE LINE',
'vin': 'VF7SAHNZ6HW504569',
'year': 2017}
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA17%2520CVN%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [bca.uk] INFO: Saving data for MA17%20CVN: {'created_time': 1774696064.094092, 'last_price_update_time': 1774696064.094102, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA17%2520CVN') HTTP/1.1" 204 0
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798673/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798673>
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814318/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814318>
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802686/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802686>
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798641/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798641>
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787499/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787499>
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818412/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D)
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802709/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D)
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac168810>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FNS16AHS%252F698752706%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752706/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a9295467-dc05-5a7c-8170-d45a3e57c067
2026-03-28 11:07:44 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a9295467-dc05-5a7c-8170-d45a3e57c067, skipping ID generation
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a9295467-dc05-5a7c-8170-d45a3e57c067 sending to next pipeline
2026-03-28 11:07:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a9295467-dc05-5a7c-8170-d45a3e57c067, identifier: NS16%20AHS
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea600d0>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW55WSO%252F698787506%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787506/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9bb250>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802690%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802690/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798707/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a9295467-dc05-5a7c-8170-d45a3e57c067 with identifier: NS16%20AHS
2026-03-28 11:07:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a9295467-dc05-5a7c-8170-d45a3e57c067 with identifier: NS16%20AHS
2026-03-28 11:07:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a9295467-dc05-5a7c-8170-d45a3e57c067 with identifier: NS16%20AHS to the API
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752706/600>
{'auction_title': '',
'c_o_2_emission_value': 103,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_expert_report_file_ec47aedb-797e-470b-8679-9d6812f9f558.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=NS16%20AHS-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.1L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a9295467-dc05-5a7c-8170-d45a3e57c067',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'NS16 AHS',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=NS16%20AHS&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'MERCEDES-BENZ',
'model': 'A200 D',
'odometer': 79197,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 49820,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752706/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 48075,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45600,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752758/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46537,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752789/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43550,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752818/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42609,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752842/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62470,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752875/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 61993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752906/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75837,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752933/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a9295467-dc05-5a7c-8170-d45a3e57c067/a9295467-dc05-5a7c-8170-d45a3e57c067_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/NS16AHS/698752965/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ A200 D 2.1 AMG LINE PREMIUM PLUS DCT Hatchback',
'transmission': 'automatic',
'trim': 'AMG LINE PREMIUM PLUS DCT',
'vin': 'WDD1760082J483170',
'year': 2016}
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NS16%2520AHS%27 HTTP/1.1" 200 None
2026-03-28 11:07:44 [bca.uk] INFO: Saving data for NS16%20AHS: {'created_time': 1774696064.719009, 'last_price_update_time': 1774696064.719022, 'auction_closing_time': 1774951200.0}
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='NS16%2520AHS') HTTP/1.1" 204 0
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802662>
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798670/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D)
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818387/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818387>
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915645/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915645>
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915692/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915669/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802731/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b9b10>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE58JHU%252F698818412%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818412/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e422e50>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN58UCF%252F698802709%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802709/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea62dd0>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798707%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798707/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787499/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW55WSO/42807921?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=ECObaVyd9gRgz05Xmcp%2BESM7xLmJDF9h2X%2FEVj26GEo%3D)
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798641/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK05KCN/42808014?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=gANA8pybdk4x89IPcI7C6tEJdd9J09Ln4zVAzOu53iI%3D)
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814318/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC60AWJ/42808422?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=RQQ4sN7yvoCoEuv1AhH2XXwb0rtF4sUe2LFKtHE6sHE%3D)
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798673/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN54DZL/42808137?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=qf0jPnBs9kEZx0kCISPWyAnTF5%2FHmUBTBzEUSHUjgwM%3D)
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802711/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802711>
2026-03-28 11:07:44 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915668>
2026-03-28 11:07:44 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802686/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D)
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffd8fd0>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD08AYG%252F698798670%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798670/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc98dd0>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915692%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915692/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaca350>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915669%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915669/600 saved to cache
2026-03-28 11:07:44 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:44 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac315650>
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:44 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802731%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802731/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798689/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798689>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798661/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798661>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798665/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798665>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798636>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814304/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698814304>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818387/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae786310>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW55WSO%252F698787499%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787499/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3e4950>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK05KCN%252F698798641%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798641/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcf4050>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC60AWJ%252F698814318%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814318/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac115650>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN54DZL%252F698798673%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798673/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 46d5df6b-48cf-580f-b920-c2fa62de29df
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff5f850>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN58UCF%252F698802686%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802686/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915645/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802671/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802671>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787492/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698787492>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802640>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915636/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915636>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818373/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818373>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaa30d0>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE58JHU%252F698818387%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818387/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad319490>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802662%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802662/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915646/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915646>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802711/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK05KCN/42808014?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=gANA8pybdk4x89IPcI7C6tEJdd9J09Ln4zVAzOu53iI%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798661/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798689/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac3b6e90>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915645%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915645/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814304/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC60AWJ/42808422?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=RQQ4sN7yvoCoEuv1AhH2XXwb0rtF4sUe2LFKtHE6sHE%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915636/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802687/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802687>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798665/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/VN54DZL/42808137?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=qf0jPnBs9kEZx0kCISPWyAnTF5%2FHmUBTBzEUSHUjgwM%3D)
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e23ef50>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915668%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915668/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818373/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787492/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW55WSO/42807921?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=ECObaVyd9gRgz05Xmcp%2BESM7xLmJDF9h2X%2FEVj26GEo%3D)
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc623d0>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802711%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802711/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798675/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798675>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798654>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802671/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D)
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc856d0>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK05KCN%252F698798636%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798636/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe36650>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD08AYG%252F698798661%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798661/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:45 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffda550>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798689%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798689/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798634/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BK05KCN-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814291/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=YC60AWJ-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=KW55WSO-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915646/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD17%20TZF-GB>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802654/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802654>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818359/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818359>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802687/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D)
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802625/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802625>
2026-03-28 11:07:45 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798675/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915624/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915624>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915626/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915626>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798668>
2026-03-28 11:07:45 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802668/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802668>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac317010>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC60AWJ%252F698814304%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814304/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb92490>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915636%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915636/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac243f90>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802640%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802640/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb27050>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FVN54DZL%252F698798665%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798665/600 saved to cache
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 46d5df6b-48cf-580f-b920-c2fa62de29df
2026-03-28 11:07:45 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 46d5df6b-48cf-580f-b920-c2fa62de29df, skipping ID generation
2026-03-28 11:07:45 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 46d5df6b-48cf-580f-b920-c2fa62de29df sending to next pipeline
2026-03-28 11:07:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 46d5df6b-48cf-580f-b920-c2fa62de29df, identifier: VN54%20DZL
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e8ea150>
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:45 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE58JHU%252F698818373%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818373/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ae786210>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW55WSO%252F698787492%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787492/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4229d0>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN58UCF%252F698802671%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802671/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:07:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 46d5df6b-48cf-580f-b920-c2fa62de29df with identifier: VN54%20DZL
2026-03-28 11:07:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 46d5df6b-48cf-580f-b920-c2fa62de29df with identifier: VN54%20DZL
2026-03-28 11:07:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 46d5df6b-48cf-580f-b920-c2fa62de29df with identifier: VN54%20DZL to the API
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798665/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_expert_report_file_81012564-0707-4cba-b88d-00a091286b79.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN54%20DZL-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '46d5df6b-48cf-580f-b920-c2fa62de29df',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VN54 DZL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN54%20DZL&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 54818,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45850,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798665/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42815,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798673/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_46d5df6b-48cf-580f-b920-c2fa62de29df/46d5df6b-48cf-580f-b920-c2fa62de29df_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41117,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/VN54DZL/698798681/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2004-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.4 FLAME Hatchback',
'transmission': 'manual',
'trim': 'FLAME',
'vin': 'WF0DXXGAJD4L77547',
'year': 2004}
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN54%2520DZL%27 HTTP/1.1" 200 None
2026-03-28 11:07:46 [bca.uk] INFO: Saving data for VN54%20DZL: {'created_time': 1774696066.463224, 'last_price_update_time': 1774696066.46324, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN54%2520DZL') HTTP/1.1" 204 0
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818359/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D)
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebfb610>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915646%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915646/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fffa9d0>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802687%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802687/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814291/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/YC60AWJ/42808422?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=RQQ4sN7yvoCoEuv1AhH2XXwb0rtF4sUe2LFKtHE6sHE%3D)
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/KW55WSO/42807921?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=ECObaVyd9gRgz05Xmcp%2BESM7xLmJDF9h2X%2FEVj26GEo%3D)
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798634/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BK05KCN/42808014?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=gANA8pybdk4x89IPcI7C6tEJdd9J09Ln4zVAzOu53iI%3D)
2026-03-28 11:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798644/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798644>
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802654/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D)
2026-03-28 11:07:46 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D> from <GET https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD55%20ULT-GB>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94bac6ab10>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD08AYG%252F698798654%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798654/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea490d0>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798675%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798675/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94bc134c10>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE58JHU%252F698818359%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818359/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e281d50>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FYC60AWJ%252F698814291%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814291/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 3c1070f3-e634-5279-aa25-131d59b68f50
2026-03-28 11:07:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 3c1070f3-e634-5279-aa25-131d59b68f50, skipping ID generation
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 3c1070f3-e634-5279-aa25-131d59b68f50 sending to next pipeline
2026-03-28 11:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3c1070f3-e634-5279-aa25-131d59b68f50, identifier: YC60%20AWJ
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fff8cd0>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FKW55WSO%252F698787484%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787484/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item a76f855b-ad2f-5512-95a5-962ebc6ded4f
2026-03-28 11:07:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: a76f855b-ad2f-5512-95a5-962ebc6ded4f, skipping ID generation
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item a76f855b-ad2f-5512-95a5-962ebc6ded4f sending to next pipeline
2026-03-28 11:07:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a76f855b-ad2f-5512-95a5-962ebc6ded4f, identifier: KW55%20WSO
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd28c50>
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:46 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBK05KCN%252F698798634%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798634/600 saved to cache
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 4285709e-1eb4-5199-8692-2365a9114f52
2026-03-28 11:07:46 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 4285709e-1eb4-5199-8692-2365a9114f52, skipping ID generation
2026-03-28 11:07:46 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 4285709e-1eb4-5199-8692-2365a9114f52 sending to next pipeline
2026-03-28 11:07:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4285709e-1eb4-5199-8692-2365a9114f52, identifier: BK05%20KCN
2026-03-28 11:07:47 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:47 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4ed390>
2026-03-28 11:07:47 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:47 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN58UCF%252F698802654%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802654/600 saved to cache
2026-03-28 11:07:47 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3c1070f3-e634-5279-aa25-131d59b68f50 with identifier: YC60%20AWJ
2026-03-28 11:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3c1070f3-e634-5279-aa25-131d59b68f50 with identifier: YC60%20AWJ
2026-03-28 11:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3c1070f3-e634-5279-aa25-131d59b68f50 with identifier: YC60%20AWJ to the API
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814291/600>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_expert_report_file_41fe7e38-6201-4553-bcf2-d8712c8967c4.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YC60%20AWJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '3c1070f3-e634-5279-aa25-131d59b68f50',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YC60 AWJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YC60%20AWJ&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'RENAULT',
'model': 'CLIO',
'odometer': 144876,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43125,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814291/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43082,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814304/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41099,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814318/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_3c1070f3-e634-5279-aa25-131d59b68f50/3c1070f3-e634-5279-aa25-131d59b68f50_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40362,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/YC60AWJ/698814332/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2010-01-01',
'seller_name': None,
'title': 'RENAULT CLIO 1.2 16V EXTREME Hatchback',
'transmission': 'manual',
'trim': '16V EXTREME',
'vin': 'VF1CR1J0H44178724',
'year': 2010}
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC60%2520AWJ%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [bca.uk] INFO: Saving data for YC60%20AWJ: {'created_time': 1774696067.4809, 'last_price_update_time': 1774696067.480913, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YC60%2520AWJ') HTTP/1.1" 204 0
2026-03-28 11:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a76f855b-ad2f-5512-95a5-962ebc6ded4f with identifier: KW55%20WSO
2026-03-28 11:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a76f855b-ad2f-5512-95a5-962ebc6ded4f with identifier: KW55%20WSO
2026-03-28 11:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a76f855b-ad2f-5512-95a5-962ebc6ded4f with identifier: KW55%20WSO to the API
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787484/600>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_expert_report_file_4e1b40af-3e96-42a6-9165-33f650378858.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KW55%20WSO-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'a76f855b-ad2f-5512-95a5-962ebc6ded4f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KW55 WSO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KW55%20WSO&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'C3',
'odometer': 129947,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45297,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787492/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43289,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787499/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_a76f855b-ad2f-5512-95a5-962ebc6ded4f/a76f855b-ad2f-5512-95a5-962ebc6ded4f_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42440,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/KW55WSO/698787506/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2006-01-01',
'seller_name': None,
'title': 'CITROEN C3 1.6 HDI 16V SX Hatchback',
'transmission': 'manual',
'trim': 'HDI 16V SX',
'vin': 'VF7FC9HXC27381310',
'year': 2006}
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW55%2520WSO%27 HTTP/1.1" 200 None
2026-03-28 11:07:47 [bca.uk] INFO: Saving data for KW55%20WSO: {'created_time': 1774696067.844548, 'last_price_update_time': 1774696067.844559, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KW55%2520WSO') HTTP/1.1" 204 0
2026-03-28 11:07:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4285709e-1eb4-5199-8692-2365a9114f52 with identifier: BK05%20KCN
2026-03-28 11:07:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4285709e-1eb4-5199-8692-2365a9114f52 with identifier: BK05%20KCN
2026-03-28 11:07:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4285709e-1eb4-5199-8692-2365a9114f52 with identifier: BK05%20KCN to the API
2026-03-28 11:07:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798634/600>
{'auction_title': '',
'c_o_2_emission_value': 178,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_expert_report_file_ae33db86-af49-4f42-a781-061547ad83cc.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK05%20KCN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4285709e-1eb4-5199-8692-2365a9114f52',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK05 KCN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK05%20KCN&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'CITROEN',
'model': 'XSARA PICASSO',
'odometer': 106296,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45221,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798634/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44591,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43859,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798641/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_4285709e-1eb4-5199-8692-2365a9114f52/4285709e-1eb4-5199-8692-2365a9114f52_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43642,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BK05KCN/698798649/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'CITROEN XSARA PICASSO 1.6 DESIRE 2 MPV',
'transmission': 'manual',
'trim': 'DESIRE 2',
'vin': 'VF7CHNFVK39873989',
'year': 2005}
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK05%2520KCN%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [bca.uk] INFO: Saving data for BK05%20KCN: {'created_time': 1774696068.303896, 'last_price_update_time': 1774696068.303907, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK05%2520KCN') HTTP/1.1" 204 0
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802631/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802631>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818336/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698818336>
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802602/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802602>
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915626/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798668/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915624/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802625/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ad151ed0>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_expert_report_file_b32e1f51-f450-42b9-bcc8-d519f1f77a95.pdf HTTP/1.1" 201 0
2026-03-28 11:07:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49adde6a-8f07-509c-9265-f5190a0663cc, skipping ID generation
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DBD17TZF-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD17TZF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809468%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809468 not downloaded yet
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809484%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809484 not downloaded yet
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809500%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809500 not downloaded yet
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809516%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809516 not downloaded yet
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915600/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915600>
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809543%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809543 not downloaded yet
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798640/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD08AYG-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b9390>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802668%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802668/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ae650>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915626%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915626/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4ba1d0>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798668%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798668/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e288ad0>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915624%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915624/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9b9390>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802625%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802625/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802648/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802648>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915594/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915594>
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802602/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798662/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798662>
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809561%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809561 not downloaded yet
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798644/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D)
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809584%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809584 not downloaded yet
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D> (referer: https://www.bca.co.uk/)
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809607%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809607 not downloaded yet
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698809629%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809629 not downloaded yet
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818336/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/CE58JHU/42808487?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=CKbwWrZY9nVcIaAK5C160N9MiIGtMB077y7MjW%2Fl8zE%3D)
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802631/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WN58UCF/42808237?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=GE%2Fv84thQY8aA4Kq4krNKdJNX6nACri7UAL5PYKyXwM%3D)
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915573/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915573>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802581/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802581>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798655/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698798655>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802630/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698802630>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915572/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698915572>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc9ab50>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802602%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802602/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798640/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD08AYG/42808150?sv=2020-08-04&st=2026-03-28T11%3A01%3A17Z&se=2026-03-28T11%3A26%3A17Z&sr=b&sp=r&sig=WDFPy7VeVWoOfojPtQLzYA8%2Fa2Gl8pGmPY3QQF6Z6II%3D)
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebef050>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD08AYG%252F698798644%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798644/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915600/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915594/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809516/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809516>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809584/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809584>
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809543/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809543>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac13c190>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_expert_report_file_2efc781d-9fe0-459e-9167-ab5ca7b59d76.pdf HTTP/1.1" 201 0
2026-03-28 11:07:48 [crawlers.middlewares.report_download_middleware] INFO: Downloaded report for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7, skipping ID generation
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloading 10 photos for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26Reg%3DLD55ULT-GB%26grp%3Dpublic%26obl%3Dhht3%2CManheim%26minwidth%3D600%26width%3D600%26default%3D5%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD55ULT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5 not downloaded yet
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798662/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802648/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:07:48 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809607/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809607>
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780293%27 HTTP/1.1" 200 None
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780293 not downloaded yet
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e874ed0>
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:48 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FCE58JHU%252F698818336%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818336/600 saved to cache
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0
2026-03-28 11:07:48 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0, skipping ID generation
2026-03-28 11:07:48 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 sending to next pipeline
2026-03-28 11:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0, identifier: CE58%20JHU
2026-03-28 11:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 with identifier: CE58%20JHU
2026-03-28 11:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 with identifier: CE58%20JHU
2026-03-28 11:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 28d234b0-1058-54d8-a5a5-a13b20ccbdc0 with identifier: CE58%20JHU to the API
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818336/600>
{'auction_title': '',
'c_o_2_emission_value': 154,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_expert_report_file_ed193d62-783f-4a4b-82c2-f70db407762d.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE58%20JHU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '28d234b0-1058-54d8-a5a5-a13b20ccbdc0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'CE58 JHU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE58%20JHU&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 98740,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41734,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818336/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818359/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38722,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818373/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 38993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818387/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_28d234b0-1058-54d8-a5a5-a13b20ccbdc0/28d234b0-1058-54d8-a5a5-a13b20ccbdc0_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 93438,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/CE58JHU/698818412/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 CLUB 16V Hatchback',
'transmission': 'automatic',
'trim': 'CLUB 16V',
'vin': 'W0L0SDL0894006593',
'year': 2008}
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE58%2520JHU%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [bca.uk] INFO: Saving data for CE58%20JHU: {'created_time': 1774696069.408737, 'last_price_update_time': 1774696069.408749, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE58%2520JHU') HTTP/1.1" 204 0
2026-03-28 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802630/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX16MYY/42808230?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=Y0r6kYyp7vWvkmvjM%2Bnt9IiVNuIH%2BkNFWrv%2BBS%2BpMrY%3D)
2026-03-28 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798655/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/DX15JFF/42808021?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=uBRxC59tAY%2FpFEHNCDiYslT84vK0MpOsrkrqPXG2f%2FI%3D)
2026-03-28 11:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809629/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809629>
2026-03-28 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915573/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/WK70VKG/42809582?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=EzIYjFaJaRqFr4ULMWYM9RM53xrwCgTnu5JUcClkzU4%3D)
2026-03-28 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802581/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BT13WSV/42808235?sv=2020-08-04&st=2026-03-28T11%3A01%3A15Z&se=2026-03-28T11%3A26%3A15Z&sr=b&sp=r&sig=wO50KdP9zQ4Dvd%2B%2F7jg3LzSw1f9c%2F2y62kNrKH7kEmA%3D)
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780299%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780299 not downloaded yet
2026-03-28 11:07:49 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:49 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ebf9ad0>
2026-03-28 11:07:49 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:49 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWN58UCF%252F698802631%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802631/600 saved to cache
2026-03-28 11:07:49 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 408cf7cd-5c88-5b19-ae14-d015866edb29
2026-03-28 11:07:49 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 408cf7cd-5c88-5b19-ae14-d015866edb29, skipping ID generation
2026-03-28 11:07:49 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 408cf7cd-5c88-5b19-ae14-d015866edb29 sending to next pipeline
2026-03-28 11:07:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 408cf7cd-5c88-5b19-ae14-d015866edb29, identifier: WN58%20UCF
2026-03-28 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915572/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BL57MXT/42809690?sv=2020-08-04&st=2026-03-28T11%3A01%3A16Z&se=2026-03-28T11%3A26%3A16Z&sr=b&sp=r&sig=DhewLjFAaMBsajk1rwu8ZaI4WpOOoHxTV7uPKKDmzDo%3D)
2026-03-28 11:07:49 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809561/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809561>
2026-03-28 11:07:49 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809543/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 408cf7cd-5c88-5b19-ae14-d015866edb29 with identifier: WN58%20UCF
2026-03-28 11:07:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 408cf7cd-5c88-5b19-ae14-d015866edb29 with identifier: WN58%20UCF
2026-03-28 11:07:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 408cf7cd-5c88-5b19-ae14-d015866edb29 with identifier: WN58%20UCF to the API
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802631/600>
{'auction_title': '',
'c_o_2_emission_value': 149,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_expert_report_file_4352c607-02c9-40bc-9534-c927f88e8e76.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WN58%20UCF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '408cf7cd-5c88-5b19-ae14-d015866edb29',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WN58 UCF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WN58%20UCF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FIAT',
'model': '500',
'odometer': 80045,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43741,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802631/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43014,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41260,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802671/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41129,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802686/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_408cf7cd-5c88-5b19-ae14-d015866edb29/408cf7cd-5c88-5b19-ae14-d015866edb29_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 87450,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WN58UCF/698802709/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'FIAT 500 1.4 LOUNGE Hatchback',
'transmission': 'manual',
'trim': 'LOUNGE',
'vin': 'ZFA31200000101005',
'year': 2008}
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN58%2520UCF%27 HTTP/1.1" 200 None
2026-03-28 11:07:49 [bca.uk] INFO: Saving data for WN58%20UCF: {'created_time': 1774696069.990276, 'last_price_update_time': 1774696069.990287, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WN58%2520UCF') HTTP/1.1" 204 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780306%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780306 not downloaded yet
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac2f5610>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD08AYG%252F698798640%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798640/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a
2026-03-28 11:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: f403886d-03c6-5fb8-8b41-8c5d5e920a1a, skipping ID generation
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item f403886d-03c6-5fb8-8b41-8c5d5e920a1a sending to next pipeline
2026-03-28 11:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f403886d-03c6-5fb8-8b41-8c5d5e920a1a, identifier: BD08%20AYG
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0e310>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915600%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915600/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb19390>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915594%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915594/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fe0df90>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798662%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798662/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd319d0>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802648%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802648/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809500/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809500>
2026-03-28 11:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809484/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809484>
2026-03-28 11:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809516/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:50 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f403886d-03c6-5fb8-8b41-8c5d5e920a1a with identifier: BD08%20AYG
2026-03-28 11:07:50 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f403886d-03c6-5fb8-8b41-8c5d5e920a1a with identifier: BD08%20AYG
2026-03-28 11:07:50 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f403886d-03c6-5fb8-8b41-8c5d5e920a1a with identifier: BD08%20AYG to the API
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798640/600>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_expert_report_file_6e358888-d3d7-4e54-9a2b-a80de8a9fd65.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD08%20AYG-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'f403886d-03c6-5fb8-8b41-8c5d5e920a1a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD08 AYG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD08%20AYG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'RENAULT',
'model': 'MEGANE',
'odometer': 145558,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44475,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43993,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798644/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42606,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798654/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41797,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798661/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42805,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798670/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_f403886d-03c6-5fb8-8b41-8c5d5e920a1a/f403886d-03c6-5fb8-8b41-8c5d5e920a1a_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42583,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD08AYG/698798677/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2008-01-01',
'seller_name': None,
'title': 'RENAULT MEGANE 1.5 DCI 106 DYNAMIQUE Hatchback',
'transmission': 'manual',
'trim': 'DCI 106 DYNAMIQUE',
'vin': 'VF1CMSE0639035738',
'year': 2008}
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD08%2520AYG%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [bca.uk] INFO: Saving data for BD08%20AYG: {'created_time': 1774696070.674342, 'last_price_update_time': 1774696070.674354, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD08%2520AYG') HTTP/1.1" 204 0
2026-03-28 11:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809584/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:50 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809607/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780312%27 HTTP/1.1" 200 None
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780312 not downloaded yet
2026-03-28 11:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780282/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=LD55ULT-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:50 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809468/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698809468>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e422950>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX16MYY%252F698802630%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802630/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item b761556c-b9e2-584e-8b60-6ef79cfe0123
2026-03-28 11:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: b761556c-b9e2-584e-8b60-6ef79cfe0123, skipping ID generation
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item b761556c-b9e2-584e-8b60-6ef79cfe0123 sending to next pipeline
2026-03-28 11:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b761556c-b9e2-584e-8b60-6ef79cfe0123, identifier: DX16%20MYY
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e4200d0>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FDX15JFF%252F698798655%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798655/600 saved to cache
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e
2026-03-28 11:07:50 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 8cbb3191-6cbb-56b9-a02d-5948ba86518e, skipping ID generation
2026-03-28 11:07:50 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 8cbb3191-6cbb-56b9-a02d-5948ba86518e sending to next pipeline
2026-03-28 11:07:50 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8cbb3191-6cbb-56b9-a02d-5948ba86518e, identifier: DX15%20JFF
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e9c0bd0>
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:50 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:50 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FWK70VKG%252F698915573%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915573/600 saved to cache
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21
2026-03-28 11:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21, skipping ID generation
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 sending to next pipeline
2026-03-28 11:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21, identifier: WK70%20VKG
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eac91d0>
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBT13WSV%252F698802581%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802581/600 saved to cache
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85
2026-03-28 11:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 6ed2dcfb-35de-5ada-ad91-353ae2183e85, skipping ID generation
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 6ed2dcfb-35de-5ada-ad91-353ae2183e85 sending to next pipeline
2026-03-28 11:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 6ed2dcfb-35de-5ada-ad91-353ae2183e85, identifier: BT13%20WSV
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff3cf50>
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBL57MXT%252F698915572%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915572/600 saved to cache
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 1e488065-6fe4-54f4-8f63-4ae87132ae79
2026-03-28 11:07:51 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 1e488065-6fe4-54f4-8f63-4ae87132ae79, skipping ID generation
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 1e488065-6fe4-54f4-8f63-4ae87132ae79 sending to next pipeline
2026-03-28 11:07:51 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1e488065-6fe4-54f4-8f63-4ae87132ae79, identifier: BL57%20MXT
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e420990>
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:51 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809543%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809543/600 saved to cache
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:51 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809629/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780320%27 HTTP/1.1" 200 None
2026-03-28 11:07:51 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780320 not downloaded yet
2026-03-28 11:07:51 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY
2026-03-28 11:07:51 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY
2026-03-28 11:07:51 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b761556c-b9e2-584e-8b60-6ef79cfe0123 with identifier: DX16%20MYY to the API
2026-03-28 11:07:51 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802630/600>
{'auction_title': '',
'c_o_2_emission_value': 108,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_expert_report_file_e741c999-cae1-40e3-b29d-b08cd497670e.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX16%20MYY-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b761556c-b9e2-584e-8b60-6ef79cfe0123',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX16 MYY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX16%20MYY&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FOCUS',
'odometer': 104167,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43018,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802630/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42556,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802648/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42483,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42492,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802687/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75566,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802711/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71529,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802731/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_b761556c-b9e2-584e-8b60-6ef79cfe0123/b761556c-b9e2-584e-8b60-6ef79cfe0123_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 77098,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX16MYY/698802750/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'FORD FOCUS 1.0 E/B 125 TITANIUM Hatchback',
'transmission': 'manual',
'trim': 'E/B 125 TITANIUM',
'vin': 'WF05XXGCC5GB19734',
'year': 2016}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520MYY%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [bca.uk] INFO: Saving data for DX16%20MYY: {'created_time': 1774696072.208053, 'last_price_update_time': 1774696072.208063, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX16%2520MYY') HTTP/1.1" 204 0
2026-03-28 11:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8cbb3191-6cbb-56b9-a02d-5948ba86518e with identifier: DX15%20JFF
2026-03-28 11:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8cbb3191-6cbb-56b9-a02d-5948ba86518e with identifier: DX15%20JFF
2026-03-28 11:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8cbb3191-6cbb-56b9-a02d-5948ba86518e with identifier: DX15%20JFF to the API
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798655/600>
{'auction_title': '',
'c_o_2_emission_value': 99,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_expert_report_file_1b5bc984-71db-44b9-b340-4d1259238a5a.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DX15%20JFF-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8cbb3191-6cbb-56b9-a02d-5948ba86518e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DX15 JFF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DX15%20JFF&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'FORD',
'model': 'FIESTA',
'odometer': 47880,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45958,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798655/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44254,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43419,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43631,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798675/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 96789,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798689/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 71434,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798707/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_8cbb3191-6cbb-56b9-a02d-5948ba86518e/8cbb3191-6cbb-56b9-a02d-5948ba86518e_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 90530,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/DX15JFF/698798716/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD FIESTA 1.0 E/B 100 ZETEC Hatchback',
'transmission': 'manual',
'trim': 'E/B 100 ZETEC',
'vin': 'WF0DXXGAKDFC81978',
'year': 2015}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX15%2520JFF%27 HTTP/1.1" 200 None
2026-03-28 11:07:52 [bca.uk] INFO: Saving data for DX15%20JFF: {'created_time': 1774696072.606533, 'last_price_update_time': 1774696072.606544, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DX15%2520JFF') HTTP/1.1" 204 0
2026-03-28 11:07:52 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG
2026-03-28 11:07:52 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG
2026-03-28 11:07:52 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: cc5fb3ee-7390-59a9-99c4-1e98d0b53d21 with identifier: WK70%20VKG to the API
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:52 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915573/600>
{'auction_title': '',
'c_o_2_emission_value': 146,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_expert_report_file_9d147983-bab0-45dc-8c26-0bf506d09dde.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WK70%20VKG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'cc5fb3ee-7390-59a9-99c4-1e98d0b53d21',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WK70 VKG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WK70%20VKG&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'VAUXHALL',
'model': 'CROSSLAND X',
'odometer': 37092,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44663,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915573/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43143,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915594/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42092,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915626/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41006,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915636/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40832,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915645/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64520,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915669/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_cc5fb3ee-7390-59a9-99c4-1e98d0b53d21/cc5fb3ee-7390-59a9-99c4-1e98d0b53d21_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64000,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/WK70VKG/698915699/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2020-01-01',
'seller_name': None,
'title': 'VAUXHALL CROSSLAND X 1.2 T 130 ELITE S/S Hatchback',
'transmission': 'automatic',
'trim': 'T 130 ELITE S/S',
'vin': 'W0V7H9EB3L4329560',
'year': 2020}
2026-03-28 11:07:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK70%2520VKG%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [bca.uk] INFO: Saving data for WK70%20VKG: {'created_time': 1774696073.002829, 'last_price_update_time': 1774696073.002841, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WK70%2520VKG') HTTP/1.1" 204 0
2026-03-28 11:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV
2026-03-28 11:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV
2026-03-28 11:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 6ed2dcfb-35de-5ada-ad91-353ae2183e85 with identifier: BT13%20WSV to the API
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802581/600>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_expert_report_file_5d92f9a1-71bc-44d6-9863-100d47e887c5.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT13%20WSV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '6ed2dcfb-35de-5ada-ad91-353ae2183e85',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BT13 WSV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT13%20WSV&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'NISSAN',
'model': 'QASHQAI',
'odometer': 127069,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43245,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802581/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42389,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802602/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41394,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802625/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40327,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802640/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40152,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802662/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78671,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802690/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_6ed2dcfb-35de-5ada-ad91-353ae2183e85/6ed2dcfb-35de-5ada-ad91-353ae2183e85_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 62060,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BT13WSV/698802722/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'NISSAN QASHQAI 1.6 DCI 130 TEKNA S/S Hatchback',
'transmission': 'manual',
'trim': 'DCI 130 TEKNA S/S',
'vin': 'SJNFEAJ10U2829678',
'year': 2013}
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT13%2520WSV%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [bca.uk] INFO: Saving data for BT13%20WSV: {'created_time': 1774696073.381553, 'last_price_update_time': 1774696073.381565, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT13%2520WSV') HTTP/1.1" 204 0
2026-03-28 11:07:53 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1e488065-6fe4-54f4-8f63-4ae87132ae79 with identifier: BL57%20MXT
2026-03-28 11:07:53 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1e488065-6fe4-54f4-8f63-4ae87132ae79 with identifier: BL57%20MXT
2026-03-28 11:07:53 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1e488065-6fe4-54f4-8f63-4ae87132ae79 with identifier: BL57%20MXT to the API
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:53 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915572/600>
{'auction_title': '',
'c_o_2_emission_value': 164,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_expert_report_file_70285c88-ec07-45d7-ad23-b8edfe3c69c0.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BL57%20MXT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1e488065-6fe4-54f4-8f63-4ae87132ae79',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BL57 MXT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BL57%20MXT&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'SUZUKI',
'model': 'SWIFT',
'odometer': 49832,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42974,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915572/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 42035,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915600/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41168,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915624/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41262,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915646/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 75212,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915668/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 50969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915692/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_1e488065-6fe4-54f4-8f63-4ae87132ae79/1e488065-6fe4-54f4-8f63-4ae87132ae79_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 65314,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BL57MXT/698915717/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2007-01-01',
'seller_name': None,
'title': 'SUZUKI SWIFT 1.5 GLX Hatchback',
'transmission': 'automatic',
'trim': 'GLX',
'vin': 'TSMMZC21S00504052',
'year': 2007}
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL57%2520MXT%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [bca.uk] INFO: Saving data for BL57%20MXT: {'created_time': 1774696073.75828, 'last_price_update_time': 1774696073.758291, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BL57%2520MXT') HTTP/1.1" 204 0
2026-03-28 11:07:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780293/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780293>
2026-03-28 11:07:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809453/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&Reg=BD17TZF-GB&grp=public&obl=hht3,Manheim&minwidth=600&width=600&default=5>
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5e24d0>
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809516%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809516/600 saved to cache
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780299/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780299>
2026-03-28 11:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809500/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809484/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809561/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780326%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780326 not downloaded yet
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff63e10>
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809584%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809584/600 saved to cache
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eaef910>
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809607%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809607/600 saved to cache
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:53 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac483ad0>
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:53 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809629%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809629/600 saved to cache
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780282/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:53 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809468/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780312/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780312>
2026-03-28 11:07:53 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780306/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780306>
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780339%27 HTTP/1.1" 200 None
2026-03-28 11:07:53 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780339 not downloaded yet
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780350%27 HTTP/1.1" 200 None
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780350 not downloaded yet
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac35f050>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809500%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809500/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ff7cdd0>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809484%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809484/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:54 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:54 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:54 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:54 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc85610>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809561%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809561/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780293/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780299/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809453/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/BD17TZF/42808107?sv=2020-08-04&st=2026-03-28T11%3A07%3A45Z&se=2026-03-28T11%3A32%3A45Z&sr=b&sp=r&sig=QNUrtAkX4o0e3kapEVKtkKqvbPJqnmBEc%2BGmL5OBc7s%3D)
2026-03-28 11:07:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780320/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780320>
2026-03-28 11:07:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780326/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780326>
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780312/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780306/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /PhotoDownloadCache()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27https%3A%252F%252Fwww1.bcaimage.com%252FDocument%253FDocType%3DVehicleImage%26width%3D600%26docId%3D698780363%27 HTTP/1.1" 200 None
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780363 not downloaded yet
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc87910>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780282%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780282/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949e5ce950>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809468%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809468/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd4a690>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_1.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780293%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780293/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 1 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780339/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780339>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949eb68f50>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_2.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780299%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780299/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 2 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780320/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780363/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780363>
2026-03-28 11:07:54 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780350/600> from <GET https://www1.bcaimage.com/Document?DocType=VehicleImage&width=600&docId=698780350>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ffc5b10>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_0.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FBD17TZF%252F698809453%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809453/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 0 for item 49adde6a-8f07-509c-9265-f5190a0663cc
2026-03-28 11:07:54 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 49adde6a-8f07-509c-9265-f5190a0663cc, skipping ID generation
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 49adde6a-8f07-509c-9265-f5190a0663cc sending to next pipeline
2026-03-28 11:07:54 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 49adde6a-8f07-509c-9265-f5190a0663cc, identifier: BD17%20TZF
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4839d0>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_4.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780312%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780312/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 4 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fc879d0>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_3.jpg HTTP/1.1" 201 0
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780306%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780306/600 saved to cache
2026-03-28 11:07:54 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 3 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:54 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF
2026-03-28 11:07:54 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF
2026-03-28 11:07:54 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 49adde6a-8f07-509c-9265-f5190a0663cc with identifier: BD17%20TZF to the API
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:54 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809453/600>
{'auction_title': '',
'c_o_2_emission_value': 114,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_expert_report_file_b32e1f51-f450-42b9-bcc8-d519f1f77a95.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BD17%20TZF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 4,
'engine': '2.0L',
'expiration_date': '2026-03-30T10:00:00Z',
'fuel_type': 'Diesel',
'id': '49adde6a-8f07-509c-9265-f5190a0663cc',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BD17 TZF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BD17%20TZF&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'JAGUAR',
'model': 'XF',
'odometer': 80313,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44110,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809453/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45478,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809468/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43279,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809484/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44048,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809500/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 40410,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809516/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 39891,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809543/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 82619,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809561/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70444,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809584/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 88145,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809607/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_49adde6a-8f07-509c-9265-f5190a0663cc/49adde6a-8f07-509c-9265-f5190a0663cc_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 73315,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/BD17TZF/698809629/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'JAGUAR XF 2.0 D 180 R SPORT Saloon',
'transmission': 'automatic',
'trim': 'D 180 R SPORT',
'vin': 'SAJBB4AN3HCY52097',
'year': 2017}
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD17%2520TZF%27 HTTP/1.1" 200 None
2026-03-28 11:07:54 [bca.uk] INFO: Saving data for BD17%20TZF: {'created_time': 1774696074.9718, 'last_price_update_time': 1774696074.971811, 'auction_closing_time': 1774864800.0}
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BD17%2520TZF') HTTP/1.1" 204 0
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780326/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780339/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fd2a110>
2026-03-28 11:07:54 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_5.jpg HTTP/1.1" 201 0
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780320%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780320/600 saved to cache
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 5 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac4ab850>
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_6.jpg HTTP/1.1" 201 0
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780326%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780326/600 saved to cache
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 6 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780363/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f94ac480b90>
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_7.jpg HTTP/1.1" 201 0
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780339%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780339/600 saved to cache
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 7 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:55 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780350/600> (referer: https://bcamediaprod.blob.core.windows.net/private/pdfs/InspectionBase/GB/LD55ULT/42807189?sv=2020-08-04&st=2026-03-28T11%3A07%3A46Z&se=2026-03-28T11%3A32%3A46Z&sr=b&sp=r&sig=%2FK9L8j79eeq9FPbJ7Rm%2BSAdA0%2FuaOjJnWwBdlqBvBr4%3D)
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949fcbfdd0>
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_9.jpg HTTP/1.1" 201 0
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780363%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780363/600 saved to cache
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 9 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: Orientation (274) - type: short (3) - value: b'\x01\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ResolutionUnit (296) - type: short (3) - value: b'\x02\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: XResolution (282) - type: rational (5) Tag Location: 46 - Data Location: 74 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: YResolution (283) - type: rational (5) Tag Location: 58 - Data Location: 82 - value: b'H\x00\x00\x00\x01\x00\x00\x00'
2026-03-28 11:07:55 [PIL.TiffImagePlugin] DEBUG: tag: ExifIFD (34665) - type: long (4) - value: b'Z\x00\x00\x00'
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container client for top-deal-listing
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container_client: <azure.storage.blob._container_client.ContainerClient object at 0x7f949ea2e8d0>
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Creating container if not exists
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing?restype=container HTTP/1.1" 409 230
2026-03-28 11:07:55 [common.azure_blobstore] INFO: Container already exists, skipping creation
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxproduction.blob.core.windows.net:443 "PUT /top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_8.jpg HTTP/1.1" 201 0
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /PhotoDownloadCache(PartitionKey='bca.uk',RowKey='https%3A%252F%252Fbcamediaprod.blob.core.windows.net%252Fpublic%252Fimages%252Fvehicle%252FGB%252FLD55ULT%252F698780350%252F600') HTTP/1.1" 204 0
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Image https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780350/600 saved to cache
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: Downloaded image 8 for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7
2026-03-28 11:07:55 [crawlers.middlewares.id_gen_middleware] DEBUG: Item already has an ID: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7, skipping ID generation
2026-03-28 11:07:55 [crawlers.middlewares.photo_download_middleware] INFO: All photos downloaded for item 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7 sending to next pipeline
2026-03-28 11:07:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7, identifier: LD55%20ULT
2026-03-28 11:07:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7 with identifier: LD55%20ULT
2026-03-28 11:07:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7 with identifier: LD55%20ULT
2026-03-28 11:07:55 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 083142a2-ea8c-5bb3-879b-0acbe8e4cdb7 with identifier: LD55%20ULT to the API
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:07:55 [scrapy.core.scraper] DEBUG: Scraped from <200 https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780350/600>
{'auction_title': '',
'c_o_2_emission_value': 121,
'car_expert_report_blob_url': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_expert_report_file_2efc781d-9fe0-459e-9167-ab5ca7b59d76.pdf',
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD55%20ULT-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '083142a2-ea8c-5bb3-879b-0acbe8e4cdb7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD55 ULT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD55%20ULT&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'KIA',
'model': 'RIO',
'odometer': 83859,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 11,
'photos': [{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_0.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44471,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780282/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_1.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 46402,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780293/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_2.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 44969,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780299/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_3.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 45137,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780306/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_4.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 43140,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780312/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_5.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 41954,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780320/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_6.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 78200,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780326/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_7.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 64772,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780339/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_8.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 70625,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780350/600',
'Width': 600},
{'BlobStorageUrl': 'https://alxproduction.blob.core.windows.net/top-deal-listing/listing_083142a2-ea8c-5bb3-879b-0acbe8e4cdb7/083142a2-ea8c-5bb3-879b-0acbe8e4cdb7_image_9.jpg',
'Extension': 'jpg',
'FileSizeInBytes': 79898,
'Height': 338,
'OriginUrl': 'https://bcamediaprod.blob.core.windows.net/public/images/vehicle/GB/LD55ULT/698780363/600',
'Width': 600}],
'price': 0,
'price_includes_vat': False,
'registration_date': '2005-01-01',
'seller_name': None,
'title': 'KIA RIO 1.5 CRDI LX Hatchback',
'transmission': 'manual',
'trim': 'CRDI LX',
'vin': 'KNEDE244266033150',
'year': 2005}
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD55%2520ULT%27 HTTP/1.1" 200 None
2026-03-28 11:07:55 [bca.uk] INFO: Saving data for LD55%20ULT: {'created_time': 1774696075.766512, 'last_price_update_time': 1774696075.766523, 'auction_closing_time': 1774778400.0}
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:07:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD55%2520ULT') HTTP/1.1" 204 0
2026-03-28 11:08:10 [scrapy.extensions.logstats] INFO: Crawled 197 pages (at 17 pages/min), scraped 428 items (at 47 items/min)
2026-03-28 11:08:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:08:47 [zyte_api._retry] DEBUG: Finished call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request' after 132.299(s), this was the 1st time calling it.
2026-03-28 11:08:47 [zyte_api._retry] DEBUG: Retrying zyte_api._async.AsyncZyteAPI.get.<locals>.request in 5.3326134801582565 seconds as it raised ClientConnectorError: Cannot connect to host api.zyte.com:443 ssl:default [Connect call failed ('69.41.180.81', 443)].
2026-03-28 11:08:52 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 2nd time calling it.
2026-03-28 11:09:02 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=11&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:02 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:02 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded
2026-03-28 11:09:02 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:02 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: KP21%20EYJ
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP21%2520EYJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for KP21%20EYJ: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: R16%20RRX
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R16%2520RRX%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for R16%20RRX: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: YH64%20HNO
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH64%2520HNO%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for YH64%20HNO: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: YC25%20ZFZ
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC25%2520ZFZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for YC25%20ZFZ: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: AF73%20EOV
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520EOV%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for AF73%20EOV: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: AF73%20FEJ
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF73%2520FEJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for AF73%20FEJ: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BC74%20HHL
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HHL%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BC74%20HHL: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BG24%20XXM
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG24%2520XXM%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BG24%20XXM: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BK24%20ZKV
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK24%2520ZKV%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BK24%20ZKV: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BL73%20ZKG
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL73%2520ZKG%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BL73%20ZKG: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BP73%20HWG
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520HWG%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BP73%20HWG: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BP73%20KDO
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP73%2520KDO%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BP73%20KDO: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BT23%20XZC
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT23%2520XZC%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BT23%20XZC: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: BW74%20DWK
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW74%2520DWK%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for BW74%20DWK: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: CF74%20PHA
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520PHA%27 HTTP/1.1" 200 None
2026-03-28 11:09:02 [bca.uk] INFO: Scrape type for CF74%20PHA: 0
2026-03-28 11:09:02 [bca.uk] INFO: Found listing with ID: CF74%20PJJ
2026-03-28 11:09:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520PJJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for CF74%20PJJ: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DL73%20LCP
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520LCP%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DL73%20LCP: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DL73%20LSZ
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520LSZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DL73%20LSZ: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DN24%20UWB
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN24%2520UWB%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DN24%20UWB: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DN70%20KGO
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN70%2520KGO%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DN70%20KGO: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DV24%20BZA
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520BZA%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DV24%20BZA: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DX71%20AAF
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX71%2520AAF%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DX71%20AAF: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DY74%20BVW
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY74%2520BVW%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DY74%20BVW: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: FD72%20URU
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD72%2520URU%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for FD72%20URU: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: FX19%20KVO
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX19%2520KVO%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for FX19%20KVO: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: GF23%20UCB
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF23%2520UCB%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for GF23%20UCB: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: GY24%20CFU
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520CFU%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for GY24%20CFU: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: HK73%20JYE
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK73%2520JYE%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for HK73%20JYE: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: KF73%20CNX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520CNX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for KF73%20CNX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: KJ19%20XCZ
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ19%2520XCZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for KJ19%20XCZ: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: KJ23%20NNB
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ23%2520NNB%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for KJ23%20NNB: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: KW24%20FNA
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW24%2520FNA%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for KW24%20FNA: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: KY19%20TNM
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY19%2520TNM%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for KY19%20TNM: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LG20%20CFV
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG20%2520CFV%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LG20%20CFV: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LG24%20ZDK
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG24%2520ZDK%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LG24%20ZDK: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LL74%20DHM
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL74%2520DHM%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LL74%20DHM: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LN24%20RKU
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RKU%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LN24%20RKU: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LS24%20EMK
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520EMK%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LS24%20EMK: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LS24%20VUX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520VUX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LS24%20VUX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: MD74%20GXE
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD74%2520GXE%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for MD74%20GXE: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: MH24%20ZDS
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH24%2520ZDS%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for MH24%20ZDS: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: ML74%20XNN
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML74%2520XNN%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for ML74%20XNN: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: MW23%20BYZ
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520BYZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for MW23%20BYZ: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: MW23%20LSZ
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW23%2520LSZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for MW23%20LSZ: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: OU72%20LYV
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU72%2520LYV%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for OU72%20LYV: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: SA69%20XVY
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA69%2520XVY%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for SA69%20XVY: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: SC69%20XMR
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520XMR%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for SC69%20XMR: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: SD73%20CPU
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD73%2520CPU%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for SD73%20CPU: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: SG69%20WDL
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG69%2520WDL%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for SG69%20WDL: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: SG71%20YGU
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG71%2520YGU%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for SG71%20YGU: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: VK24%20NBM
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK24%2520NBM%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for VK24%20NBM: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: WD74%20ECW
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD74%2520ECW%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for WD74%20ECW: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: WN74%20JZX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520JZX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for WN74%20JZX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: WN74%20OBX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN74%2520OBX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for WN74%20OBX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: WR74%20XCX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR74%2520XCX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for WR74%20XCX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YF23%20UOG
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UOG%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YF23%20UOG: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YJ73%20WSK
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ73%2520WSK%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YJ73%20WSK: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YJ73%20WUU
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ73%2520WUU%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YJ73%20WUU: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YM22%20GWY
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM22%2520GWY%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YM22%20GWY: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YY73%20UHG
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520UHG%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YY73%20UHG: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YY73%20UHP
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520UHP%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YY73%20UHP: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YY73%20XEX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XEX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YY73%20XEX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YY73%20XFS
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XFS%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YY73%20XFS: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: YY73%20XHE
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XHE%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for YY73%20XHE: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: EK73%20WBT
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK73%2520WBT%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for EK73%20WBT: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: CV18%20ZGK
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV18%2520ZGK%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for CV18%20ZGK: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LM63%20VTK
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM63%2520VTK%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LM63%20VTK: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: KP69%20EZC
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP69%2520EZC%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for KP69%20EZC: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: LM58%20ZKW
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM58%2520ZKW%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for LM58%20ZKW: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: ND66%20WXW
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND66%2520WXW%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for ND66%20WXW: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: PE15%20XVX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520XVX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for PE15%20XVX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: BJ68%20DAO
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520DAO%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for BJ68%20DAO: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: BJ70%20ULF
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ70%2520ULF%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for BJ70%20ULF: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: BN70%20UTW
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN70%2520UTW%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for BN70%20UTW: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: DF67%20WXX
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF67%2520WXX%27 HTTP/1.1" 200 None
2026-03-28 11:09:03 [bca.uk] INFO: Scrape type for DF67%20WXX: 0
2026-03-28 11:09:03 [bca.uk] INFO: Found listing with ID: EO68%20OSM
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO68%2520OSM%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for EO68%20OSM: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: GM17%20BGK
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM17%2520BGK%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for GM17%20BGK: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: KO67%20BZU
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO67%2520BZU%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for KO67%20BZU: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: KS69%20AUH
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS69%2520AUH%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for KS69%20AUH: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: LO66%20AAU
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO66%2520AAU%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for LO66%20AAU: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: MF71%20ZHD
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF71%2520ZHD%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for MF71%20ZHD: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: MW70%20BVB
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW70%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for MW70%20BVB: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: OY17%20KRU
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520KRU%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for OY17%20KRU: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: OY17%20SPZ
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520SPZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for OY17%20SPZ: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: OY66%20YSS
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY66%2520YSS%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for OY66%20YSS: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: YC68%20MYL
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520MYL%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for YC68%20MYL: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: RO72%20MAE
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO72%2520MAE%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for RO72%20MAE: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: DS65%20OCU
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520OCU%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for DS65%20OCU: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: FE67%20JCX
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE67%2520JCX%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for FE67%20JCX: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: HT68%20ERK
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT68%2520ERK%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for HT68%20ERK: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: KU65%20DZH
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU65%2520DZH%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for KU65%20DZH: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: SB12%20AFZ
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB12%2520AFZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for SB12%20AFZ: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: SB64%20HJV
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520HJV%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for SB64%20HJV: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: CJ19%20GAA
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ19%2520GAA%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for CJ19%20GAA: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: SB19%20OJD
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB19%2520OJD%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for SB19%20OJD: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: EK22%20EKC
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK22%2520EKC%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for EK22%20EKC: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: GD69%20YNC
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD69%2520YNC%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for GD69%20YNC: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: GSZ%206855
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GSZ%25206855%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for GSZ%206855: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: LL69%20HKX
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL69%2520HKX%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for LL69%20HKX: 0
2026-03-28 11:09:04 [bca.uk] INFO: Found listing with ID: LR72%20YRF
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR72%2520YRF%27 HTTP/1.1" 200 None
2026-03-28 11:09:04 [bca.uk] INFO: Scrape type for LR72%20YRF: 0
2026-03-28 11:09:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:04 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:04 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:10 [scrapy.extensions.logstats] INFO: Crawled 198 pages (at 1 pages/min), scraped 428 items (at 0 items/min)
2026-03-28 11:09:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:09:15 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:16 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:16 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded
2026-03-28 11:09:16 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:16 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: EF72%20YJG
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF72%2520YJG%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for EF72%20YJG: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: LY16%20SWW
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY16%2520SWW%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for LY16%20SWW: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: LT14%20MTK
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT14%2520MTK%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for LT14%20MTK: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: MV18%20ZXU
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV18%2520ZXU%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for MV18%20ZXU: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: SY24%20KFV
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY24%2520KFV%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for SY24%20KFV: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: OE21%20WRR
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE21%2520WRR%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for OE21%20WRR: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: GD19%20SZV
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD19%2520SZV%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for GD19%20SZV: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: KV70%20XWE
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV70%2520XWE%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for KV70%20XWE: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: PK18%20LLR
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK18%2520LLR%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for PK18%20LLR: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: SA20%20CZR
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA20%2520CZR%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for SA20%20CZR: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: SR19%20ZZV
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520ZZV%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for SR19%20ZZV: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: ST69%20RVR
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST69%2520RVR%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for ST69%20RVR: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: HN73%20OYE
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN73%2520OYE%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for HN73%20OYE: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: CV22%20JHX
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV22%2520JHX%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for CV22%20JHX: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: CA20%20HMO
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA20%2520HMO%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for CA20%20HMO: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: D21%20CPN
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27D21%2520CPN%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for D21%20CPN: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: KR70%20AOW
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR70%2520AOW%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for KR70%20AOW: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: LM19%20YBF
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM19%2520YBF%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for LM19%20YBF: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: MP19%20XWS
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520XWS%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for MP19%20XWS: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: CK22%20BGY
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK22%2520BGY%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for CK22%20BGY: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: DE64%20WRU
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE64%2520WRU%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for DE64%20WRU: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: BM19%20KKC
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BM19%2520KKC%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for BM19%20KKC: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: CU19%20HWD
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU19%2520HWD%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for CU19%20HWD: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: DA19%20JWL
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA19%2520JWL%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for DA19%20JWL: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: WT19%20AXJ
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT19%2520AXJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for WT19%20AXJ: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: YP20%20XCH
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP20%2520XCH%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for YP20%20XCH: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: LM22%20HEV
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM22%2520HEV%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for LM22%20HEV: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: FX18%20HGJ
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX18%2520HGJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for FX18%20HGJ: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: GX10%20TFN
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX10%2520TFN%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for GX10%20TFN: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: LR22%20POJ
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520POJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for LR22%20POJ: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: MV19%20OZD
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV19%2520OZD%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for MV19%20OZD: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: KK18%20NLT
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK18%2520NLT%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for KK18%20NLT: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: OY68%20HXZ
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY68%2520HXZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for OY68%20HXZ: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: WK18%20TYG
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK18%2520TYG%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for WK18%20TYG: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: KL68%20YWS
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KL68%2520YWS%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for KL68%20YWS: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: PF21%20VOH
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF21%2520VOH%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for PF21%20VOH: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: YT71%20ZPB
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT71%2520ZPB%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for YT71%20ZPB: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: SC69%20VLR
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC69%2520VLR%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for SC69%20VLR: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: YG70%20JFZ
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG70%2520JFZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for YG70%20JFZ: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: LL65%20LYY
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL65%2520LYY%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for LL65%20LYY: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: KX19%20ZFM
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX19%2520ZFM%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for KX19%20ZFM: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: DA14%20XSM
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA14%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for DA14%20XSM: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: RX73%20ZDN
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX73%2520ZDN%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for RX73%20ZDN: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: GY25%20ONT
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY25%2520ONT%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for GY25%20ONT: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: HX69%20ZKF
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX69%2520ZKF%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for HX69%20ZKF: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: DV20%20VXP
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV20%2520VXP%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for DV20%20VXP: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: EF69%20NVG
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF69%2520NVG%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for EF69%20NVG: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: GD68%20RFO
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD68%2520RFO%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for GD68%20RFO: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: HF18%20LDC
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF18%2520LDC%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for HF18%20LDC: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: HY69%20RKF
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY69%2520RKF%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for HY69%20RKF: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: RV19%20HHT
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV19%2520HHT%27 HTTP/1.1" 200 None
2026-03-28 11:09:16 [bca.uk] INFO: Scrape type for RV19%20HHT: 0
2026-03-28 11:09:16 [bca.uk] INFO: Found listing with ID: DF21%20FZO
2026-03-28 11:09:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF21%2520FZO%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for DF21%20FZO: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: BU68%20VWW
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU68%2520VWW%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for BU68%20VWW: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: BV19%20GVW
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV19%2520GVW%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for BV19%20GVW: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: DG22%20CTE
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG22%2520CTE%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for DG22%20CTE: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: ML18%20XJB
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520XJB%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for ML18%20XJB: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: MW69%20HFC
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW69%2520HFC%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for MW69%20HFC: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: SA69%20LHZ
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA69%2520LHZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for SA69%20LHZ: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: VX19%20FEH
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX19%2520FEH%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for VX19%20FEH: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: DE70%20TSU
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE70%2520TSU%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for DE70%20TSU: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: SA18%20CFY
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA18%2520CFY%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for SA18%20CFY: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: YF71%20WVH
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF71%2520WVH%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for YF71%20WVH: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: YL68%20ORJ
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL68%2520ORJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for YL68%20ORJ: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: YS18%20FWH
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520FWH%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for YS18%20FWH: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: BP69%20OJJ
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP69%2520OJJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for BP69%20OJJ: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: CK70%20YMM
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK70%2520YMM%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for CK70%20YMM: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: CX20%20KFW
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX20%2520KFW%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for CX20%20KFW: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: KW70%20FHN
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520FHN%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for KW70%20FHN: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: WJ22%20BOV
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520BOV%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for WJ22%20BOV: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: WN18%20XLF
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN18%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for WN18%20XLF: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: KN21%20ZVO
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN21%2520ZVO%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for KN21%20ZVO: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: VK69%20CTV
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK69%2520CTV%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for VK69%20CTV: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: EJ22%20VBB
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ22%2520VBB%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for EJ22%20VBB: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: GP68%20URE
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP68%2520URE%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for GP68%20URE: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: KM08%20XXA
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM08%2520XXA%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for KM08%20XXA: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: YP66%20YKK
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP66%2520YKK%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for YP66%20YKK: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: YC13%20XDV
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC13%2520XDV%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for YC13%20XDV: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: EX09%20CTK
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX09%2520CTK%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for EX09%20CTK: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: EX15%20XAZ
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX15%2520XAZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for EX15%20XAZ: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: GJ09%20UCB
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ09%2520UCB%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for GJ09%20UCB: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: KP61%20KHZ
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520KHZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for KP61%20KHZ: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: KU14%20VPZ
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU14%2520VPZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for KU14%20VPZ: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: KU62%20UWG
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU62%2520UWG%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for KU62%20UWG: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: OY62%20KUU
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY62%2520KUU%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for OY62%20KUU: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: PJ11%20LRU
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ11%2520LRU%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for PJ11%20LRU: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: ST13%20ZHD
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST13%2520ZHD%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for ST13%20ZHD: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: TT04%20RJB
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TT04%2520RJB%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for TT04%20RJB: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: VE63%20BUO
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE63%2520BUO%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for VE63%20BUO: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: AO65%20AOR
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520AOR%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for AO65%20AOR: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: AU61%20VFD
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU61%2520VFD%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for AU61%20VFD: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: AV07%20KPN
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV07%2520KPN%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for AV07%20KPN: 0
2026-03-28 11:09:17 [bca.uk] INFO: Found listing with ID: AV61%20LYA
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV61%2520LYA%27 HTTP/1.1" 200 None
2026-03-28 11:09:17 [bca.uk] INFO: Scrape type for AV61%20LYA: 2
2026-03-28 11:09:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA
2026-03-28 11:09:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8472b83a-ddd3-5e85-b379-4edea78d234a with scrape type 2
2026-03-28 11:09:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8472b83a-ddd3-5e85-b379-4edea78d234a with scrape type 2
2026-03-28 11:09:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8472b83a-ddd3-5e85-b379-4edea78d234a, identifier: AV61%20LYA
2026-03-28 11:09:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA
2026-03-28 11:09:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA
2026-03-28 11:09:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8472b83a-ddd3-5e85-b379-4edea78d234a with identifier: AV61%20LYA to the API
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=12&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 109,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AV61%20LYA-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '8472b83a-ddd3-5e85-b379-4edea78d234a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'AV61 LYA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AV61%20LYA&vehicleType=*',
'listing': 'auction',
'location': 'Thurleigh',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 136827,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.2 3 Hatchback',
'transmission': 'manual',
'trim': '3',
'vin': 'KNABX512LCT072785',
'year': 2011}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV61%2520LYA%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [bca.uk] INFO: Saving data for AV61%20LYA: {'auction_closing_time': 1774778400.0, 'created_time': 1773820262.62169, 'last_price_update_time': 1774696158.854418}
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AV61%2520LYA') HTTP/1.1" 204 0
2026-03-28 11:09:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:18 [bca.uk] INFO: Found listing with ID: BJ07%20OXE
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ07%2520OXE%27 HTTP/1.1" 200 None
2026-03-28 11:09:18 [bca.uk] INFO: Scrape type for BJ07%20OXE: 0
2026-03-28 11:09:18 [bca.uk] INFO: Found listing with ID: CX11%20XLL
2026-03-28 11:09:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX11%2520XLL%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for CX11%20XLL: 0
2026-03-28 11:09:19 [bca.uk] INFO: Found listing with ID: DP11%20NCY
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP11%2520NCY%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for DP11%20NCY: 0
2026-03-28 11:09:19 [bca.uk] INFO: Found listing with ID: EU62%20AEF
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU62%2520AEF%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for EU62%20AEF: 0
2026-03-28 11:09:19 [bca.uk] INFO: Found listing with ID: MJ16%20FXK
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ16%2520FXK%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for MJ16%20FXK: 0
2026-03-28 11:09:19 [bca.uk] INFO: Found listing with ID: DY09%20AUK
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY09%2520AUK%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for DY09%20AUK: 0
2026-03-28 11:09:19 [bca.uk] INFO: Found listing with ID: SD13%20NWC
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520NWC%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for SD13%20NWC: 0
2026-03-28 11:09:19 [bca.uk] INFO: Found listing with ID: YK62%20XBF
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK62%2520XBF%27 HTTP/1.1" 200 None
2026-03-28 11:09:19 [bca.uk] INFO: Scrape type for YK62%20XBF: 0
2026-03-28 11:09:26 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=13&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:26 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:26 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded
2026-03-28 11:09:26 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:26 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:26 [bca.uk] INFO: Found listing with ID: VN17%20XMU
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN17%2520XMU%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for VN17%20XMU: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: EA63%20PVE
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520PVE%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for EA63%20PVE: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: GL67%20YWJ
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL67%2520YWJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for GL67%20YWJ: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: IGZ%203878
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27IGZ%25203878%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for IGZ%203878: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: NK19%20LMM
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK19%2520LMM%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for NK19%20LMM: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: T140%20LPV
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27T140%2520LPV%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for T140%20LPV: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: YX13%20FTY
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX13%2520FTY%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for YX13%20FTY: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: BG61%20YNC
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG61%2520YNC%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for BG61%20YNC: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: SL15%20UGO
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL15%2520UGO%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for SL15%20UGO: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: LV59%20VRK
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520VRK%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for LV59%20VRK: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: VU63%20XOL
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU63%2520XOL%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for VU63%20XOL: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: YX17%20UZK
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX17%2520UZK%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for YX17%20UZK: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: LO17%20BZM
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO17%2520BZM%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for LO17%20BZM: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: ND64%20XVK
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND64%2520XVK%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for ND64%20XVK: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: LM05%20PMY
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM05%2520PMY%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for LM05%20PMY: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WN08%20EJO
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN08%2520EJO%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WN08%20EJO: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: LT64%20RFY
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT64%2520RFY%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for LT64%20RFY: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WM18%20TOV
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM18%2520TOV%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WM18%20TOV: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: DL65%20RZM
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL65%2520RZM%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for DL65%20RZM: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: AU14%20XMG
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU14%2520XMG%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for AU14%20XMG: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: DY11%20JYC
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY11%2520JYC%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for DY11%20JYC: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: NA12%20HKW
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA12%2520HKW%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for NA12%20HKW: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: AK12%20OAP
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK12%2520OAP%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for AK12%20OAP: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: ML21%20PXH
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML21%2520PXH%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for ML21%20PXH: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: BXZ%204666
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BXZ%25204666%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for BXZ%204666: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: NX63%20LFL
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520LFL%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for NX63%20LFL: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: YN64%20OSM
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN64%2520OSM%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for YN64%20OSM: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: CK64%20JOH
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK64%2520JOH%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for CK64%20JOH: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: DC12%20SEE
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC12%2520SEE%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for DC12%20SEE: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: FE59%20XRV
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE59%2520XRV%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for FE59%20XRV: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: RA08%20JWP
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA08%2520JWP%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for RA08%20JWP: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: SA06%20UMJ
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA06%2520UMJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for SA06%20UMJ: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: MW63%20FXS
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW63%2520FXS%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for MW63%20FXS: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: YX18%20XUA
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX18%2520XUA%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for YX18%20XUA: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: SO14%20FTD
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO14%2520FTD%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for SO14%20FTD: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: KN14%20YFH
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN14%2520YFH%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for KN14%20YFH: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: SY13%20GYG
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY13%2520GYG%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for SY13%20GYG: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: AK64%20WNF
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520WNF%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for AK64%20WNF: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: MJ66%20YYD
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ66%2520YYD%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for MJ66%20YYD: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: YG59%20LXX
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG59%2520LXX%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for YG59%20LXX: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: FT63%20VNN
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520VNN%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for FT63%20VNN: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: HY63%20XBB
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY63%2520XBB%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for HY63%20XBB: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: LV06%20XDN
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV06%2520XDN%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for LV06%20XDN: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: VK15%20FJO
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK15%2520FJO%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for VK15%20FJO: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WX63%20EOP
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX63%2520EOP%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WX63%20EOP: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: MF70%20WBE
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF70%2520WBE%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for MF70%20WBE: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: LL67%20VDZ
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL67%2520VDZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for LL67%20VDZ: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WU64%20WLK
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU64%2520WLK%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WU64%20WLK: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WM63%20BYZ
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM63%2520BYZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WM63%20BYZ: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: MJ64%20RVZ
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ64%2520RVZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for MJ64%20RVZ: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: P19%20KMM
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P19%2520KMM%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for P19%20KMM: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: PN62%20MZW
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN62%2520MZW%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for PN62%20MZW: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WP11%20XBH
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP11%2520XBH%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WP11%20XBH: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: WP59%20FLB
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP59%2520FLB%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for WP59%20FLB: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: YJ14%20XFY
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ14%2520XFY%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for YJ14%20XFY: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: CE59%20OEW
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE59%2520OEW%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for CE59%20OEW: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: CE63%20AXV
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE63%2520AXV%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for CE63%20AXV: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: EX61%20HKJ
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX61%2520HKJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:27 [bca.uk] INFO: Scrape type for EX61%20HKJ: 0
2026-03-28 11:09:27 [bca.uk] INFO: Found listing with ID: HG57%20ZGN
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG57%2520ZGN%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for HG57%20ZGN: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: KY16%20LRL
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY16%2520LRL%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for KY16%20LRL: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: EO16%20YSH
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO16%2520YSH%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for EO16%20YSH: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: FG19%20CUA
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520CUA%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for FG19%20CUA: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: AY13%20HJN
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY13%2520HJN%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for AY13%20HJN: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: CA62%20GJO
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA62%2520GJO%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for CA62%20GJO: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: SH13%20PNF
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH13%2520PNF%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for SH13%20PNF: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: WG65%20NYY
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG65%2520NYY%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for WG65%20NYY: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: MF12%20VBY
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF12%2520VBY%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for MF12%20VBY: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: GF58%20XOE
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF58%2520XOE%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for GF58%20XOE: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: WNZ%201898
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WNZ%25201898%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for WNZ%201898: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: RA16%20FGU
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA16%2520FGU%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for RA16%20FGU: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: AJ15%20UCW
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ15%2520UCW%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for AJ15%20UCW: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: GU59%20DWO
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU59%2520DWO%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for GU59%20DWO: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: RK11%20VNW
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK11%2520VNW%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for RK11%20VNW: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: SP08%20NVS
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP08%2520NVS%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for SP08%20NVS: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: BU11%20RTV
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU11%2520RTV%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for BU11%20RTV: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: KR65%20OTY
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR65%2520OTY%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for KR65%20OTY: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: RK64%20CYT
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK64%2520CYT%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for RK64%20CYT: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: LN10%20VMY
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN10%2520VMY%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for LN10%20VMY: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: DG59%20XEM
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG59%2520XEM%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for DG59%20XEM: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: SN65%20YTA
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN65%2520YTA%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for SN65%20YTA: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: YJ18%20ZAG
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ18%2520ZAG%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for YJ18%20ZAG: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: CK15%20AEP
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK15%2520AEP%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for CK15%20AEP: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: DA66%20OXP
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520OXP%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for DA66%20OXP: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: DE14%20WTA
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE14%2520WTA%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for DE14%20WTA: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: DV64%20VUB
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV64%2520VUB%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for DV64%20VUB: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: GV65%20GPK
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV65%2520GPK%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for GV65%20GPK: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: KS65%20YFC
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS65%2520YFC%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for KS65%20YFC: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: MJ18%20MZG
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520MZG%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for MJ18%20MZG: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: MT67%20CGG
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for MT67%20CGG: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: NL64%20YGU
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520YGU%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for NL64%20YGU: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: PN15%20XLB
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN15%2520XLB%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for PN15%20XLB: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: PX64%20PPV
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX64%2520PPV%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for PX64%20PPV: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: RV64%20NSO
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV64%2520NSO%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for RV64%20NSO: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: CP64%20LLR
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP64%2520LLR%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for CP64%20LLR: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: SY15%20WZH
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY15%2520WZH%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for SY15%20WZH: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: AF68%20SVE
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF68%2520SVE%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for AF68%20SVE: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: MV65%20OCE
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV65%2520OCE%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for MV65%20OCE: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: PO13%20XES
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO13%2520XES%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for PO13%20XES: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: PX08%20FZF
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX08%2520FZF%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for PX08%20FZF: 0
2026-03-28 11:09:28 [bca.uk] INFO: Found listing with ID: RJ67%20ZGP
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ67%2520ZGP%27 HTTP/1.1" 200 None
2026-03-28 11:09:28 [bca.uk] INFO: Scrape type for RJ67%20ZGP: 0
2026-03-28 11:09:28 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:28 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:31 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=14&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:31 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:31 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded
2026-03-28 11:09:31 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:31 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: SM11%20YYC
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM11%2520YYC%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for SM11%20YYC: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: WF09%20WWO
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF09%2520WWO%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for WF09%20WWO: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: YD15%20FET
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520FET%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for YD15%20FET: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: YJ63%20EVM
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520EVM%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for YJ63%20EVM: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: YN08%20UVD
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN08%2520UVD%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for YN08%20UVD: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: YR60%20HSF
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR60%2520HSF%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for YR60%20HSF: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: ET10%20FWV
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET10%2520FWV%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for ET10%20FWV: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: FFZ%202461
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FFZ%25202461%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for FFZ%202461: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: GD10%20BNJ
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD10%2520BNJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for GD10%20BNJ: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: J222%20SOB
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J222%2520SOB%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for J222%20SOB: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: LK08%20VLX
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK08%2520VLX%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for LK08%20VLX: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: ML10%20HFR
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML10%2520HFR%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for ML10%20HFR: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: NA52%20HNU
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA52%2520HNU%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for NA52%20HNU: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: NU62%20FVV
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520FVV%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for NU62%20FVV: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: AP14%20DLE
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP14%2520DLE%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for AP14%20DLE: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: BG61%20XGP
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG61%2520XGP%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for BG61%20XGP: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: BV07%20PTY
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV07%2520PTY%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for BV07%20PTY: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: DA59%20ZDF
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA59%2520ZDF%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for DA59%20ZDF: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: DN62%20BXP
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN62%2520BXP%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for DN62%20BXP: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: DU11%20ZKX
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU11%2520ZKX%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for DU11%20ZKX: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: EA63%20XHB
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520XHB%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for EA63%20XHB: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: EJ09%20JZU
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ09%2520JZU%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for EJ09%20JZU: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: EJ11%20WXD
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ11%2520WXD%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for EJ11%20WXD: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: AE08%20JGR
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE08%2520JGR%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for AE08%20JGR: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: AF63%20VLZ
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF63%2520VLZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for AF63%20VLZ: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: AJ59%20YCC
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ59%2520YCC%27 HTTP/1.1" 200 None
2026-03-28 11:09:31 [bca.uk] INFO: Scrape type for AJ59%20YCC: 0
2026-03-28 11:09:31 [bca.uk] INFO: Found listing with ID: EF69%20FGP
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF69%2520FGP%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for EF69%20FGP: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: KS71%20LRF
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS71%2520LRF%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for KS71%20LRF: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: MV22%20UCS
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV22%2520UCS%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for MV22%20UCS: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: VK73%20CAE
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK73%2520CAE%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for VK73%20CAE: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: NA14%20MLY
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520MLY%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for NA14%20MLY: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: DV12%20NKX
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV12%2520NKX%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for DV12%20NKX: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YE13%20TGX
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE13%2520TGX%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YE13%20TGX: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: KX63%20VRW
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX63%2520VRW%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for KX63%20VRW: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: WU56%20JVV
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU56%2520JVV%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for WU56%20JVV: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: MW14%20VSG
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW14%2520VSG%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for MW14%20VSG: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YG63%20XMA
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG63%2520XMA%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YG63%20XMA: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: WM64%20MZY
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM64%2520MZY%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for WM64%20MZY: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: PK67%20WXJ
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK67%2520WXJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for PK67%20WXJ: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: BG68%20USB
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG68%2520USB%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for BG68%20USB: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: CF22%20XZJ
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF22%2520XZJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for CF22%20XZJ: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YF64%20HNX
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF64%2520HNX%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YF64%20HNX: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: MK20%20NXW
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK20%2520NXW%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for MK20%20NXW: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: ND15%20ZTH
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520ZTH%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for ND15%20ZTH: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: BF65%20MXK
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520MXK%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for BF65%20MXK: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: CJ21%20DMF
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ21%2520DMF%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for CJ21%20DMF: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: CX17%20HLC
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX17%2520HLC%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for CX17%20HLC: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: CU67%20WRO
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU67%2520WRO%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for CU67%20WRO: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: NU20%20BYM
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU20%2520BYM%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for NU20%20BYM: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SE23%20USB
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE23%2520USB%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SE23%20USB: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: CX19%20CMZ
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX19%2520CMZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for CX19%20CMZ: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SJ19%20TZN
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ19%2520TZN%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SJ19%20TZN: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: HX07%20WBO
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX07%2520WBO%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for HX07%20WBO: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YT69%20XRC
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT69%2520XRC%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YT69%20XRC: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SV63%20OHA
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV63%2520OHA%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SV63%20OHA: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: WN11%20LZE
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN11%2520LZE%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for WN11%20LZE: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: WF08%20GUH
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF08%2520GUH%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for WF08%20GUH: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: PE15%20VEP
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE15%2520VEP%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for PE15%20VEP: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: BF68%20XZH
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF68%2520XZH%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for BF68%20XZH: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: WH19%20KYM
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WH19%2520KYM%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for WH19%20KYM: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: KV65%20KKF
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV65%2520KKF%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for KV65%20KKF: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: BD61%20LZS
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD61%2520LZS%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for BD61%20LZS: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: GK70%20LKL
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK70%2520LKL%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for GK70%20LKL: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: MF15%20LOA
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF15%2520LOA%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for MF15%20LOA: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SB67%20ZDO
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB67%2520ZDO%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SB67%20ZDO: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YB23%20NJU
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB23%2520NJU%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YB23%20NJU: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: VA18%20JZP
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA18%2520JZP%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for VA18%20JZP: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: PF65%20MKM
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF65%2520MKM%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for PF65%20MKM: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SY68%20MYK
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY68%2520MYK%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SY68%20MYK: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YB15%20YCN
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB15%2520YCN%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YB15%20YCN: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YP70%20OYG
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP70%2520OYG%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YP70%20OYG: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: P12%20TBE
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P12%2520TBE%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for P12%20TBE: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SA72%20DPN
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA72%2520DPN%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SA72%20DPN: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: BD64%20SVN
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520SVN%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for BD64%20SVN: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SG16%20XEM
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520XEM%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for SG16%20XEM: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: BX64%20YVD
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX64%2520YVD%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for BX64%20YVD: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: EO60%20XFZ
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520XFZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for EO60%20XFZ: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: DS65%20VAY
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520VAY%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for DS65%20VAY: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: YA72%20EKD
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA72%2520EKD%27 HTTP/1.1" 200 None
2026-03-28 11:09:32 [bca.uk] INFO: Scrape type for YA72%20EKD: 0
2026-03-28 11:09:32 [bca.uk] INFO: Found listing with ID: SG17%20XAA
2026-03-28 11:09:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520XAA%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for SG17%20XAA: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: WA16%20TJO
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA16%2520TJO%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for WA16%20TJO: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: EK13%20NDL
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK13%2520NDL%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for EK13%20NDL: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: AY66%20EOR
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY66%2520EOR%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for AY66%20EOR: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: FL70%20WDY
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL70%2520WDY%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for FL70%20WDY: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: HK71%20UCC
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK71%2520UCC%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for HK71%20UCC: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: HN67%20XHO
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN67%2520XHO%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for HN67%20XHO: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: HK22%20RGO
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK22%2520RGO%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for HK22%20RGO: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: DS67%20KWK
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS67%2520KWK%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for DS67%20KWK: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: CX15%20ULU
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX15%2520ULU%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for CX15%20ULU: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: RO14%20MMV
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO14%2520MMV%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for RO14%20MMV: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: MA13%20FHH
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA13%2520FHH%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for MA13%20FHH: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: MK17%20JHJ
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK17%2520JHJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for MK17%20JHJ: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: SG16%20EAC
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520EAC%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for SG16%20EAC: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: YS65%20LZV
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS65%2520LZV%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for YS65%20LZV: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: KO18%20CWM
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO18%2520CWM%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for KO18%20CWM: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: KP61%20JVR
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520JVR%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for KP61%20JVR: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: WK15%20WKR
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK15%2520WKR%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for WK15%20WKR: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: WX60%20CFO
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX60%2520CFO%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for WX60%20CFO: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: VK66%20PZX
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK66%2520PZX%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for VK66%20PZX: 0
2026-03-28 11:09:33 [bca.uk] INFO: Found listing with ID: SJ64%20WFB
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ64%2520WFB%27 HTTP/1.1" 200 None
2026-03-28 11:09:33 [bca.uk] INFO: Scrape type for SJ64%20WFB: 0
2026-03-28 11:09:33 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:33 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:33 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:41 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:41 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:41 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded
2026-03-28 11:09:41 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:41 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: WN62%20OGT
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN62%2520OGT%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [bca.uk] INFO: Scrape type for WN62%20OGT: 0
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: HF66%20XPD
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF66%2520XPD%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [bca.uk] INFO: Scrape type for HF66%20XPD: 0
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: NA68%20PNX
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520PNX%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [bca.uk] INFO: Scrape type for NA68%20PNX: 0
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: SH66%20VEY
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH66%2520VEY%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [bca.uk] INFO: Scrape type for SH66%20VEY: 0
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: SA67%20LLK
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA67%2520LLK%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [bca.uk] INFO: Scrape type for SA67%20LLK: 0
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: OE62%20XHT
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE62%2520XHT%27 HTTP/1.1" 200 None
2026-03-28 11:09:41 [bca.uk] INFO: Scrape type for OE62%20XHT: 0
2026-03-28 11:09:41 [bca.uk] INFO: Found listing with ID: BP74%20GVC
2026-03-28 11:09:41 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP74%2520GVC%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for BP74%20GVC: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: M5%20OPK
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M5%2520OPK%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for M5%20OPK: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: YB14%20PZY
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB14%2520PZY%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for YB14%20PZY: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: YT15%20HZM
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT15%2520HZM%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for YT15%20HZM: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: SB17%20NPK
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB17%2520NPK%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for SB17%20NPK: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: OX73%20BFE
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OX73%2520BFE%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for OX73%20BFE: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: EY13%20FZE
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY13%2520FZE%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for EY13%20FZE: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: BC73%20NTT
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC73%2520NTT%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for BC73%20NTT: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: VK21%20GPO
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520GPO%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for VK21%20GPO: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: PK65%20OBP
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK65%2520OBP%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for PK65%20OBP: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: AY66%20ZNA
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY66%2520ZNA%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for AY66%20ZNA: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: NA07%20HJZ
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA07%2520HJZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for NA07%20HJZ: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: RV18%20HSL
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV18%2520HSL%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for RV18%20HSL: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: YR70%20UMF
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR70%2520UMF%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for YR70%20UMF: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: FJ18%20XJY
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ18%2520XJY%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for FJ18%20XJY: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: RA15%20GLF
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA15%2520GLF%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for RA15%20GLF: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: VN62%20UNY
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN62%2520UNY%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for VN62%20UNY: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: FSZ%204071
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FSZ%25204071%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for FSZ%204071: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: DP24%20AKN
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP24%2520AKN%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for DP24%20AKN: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: MM22%20HGF
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM22%2520HGF%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for MM22%20HGF: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: OY67%20EZZ
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY67%2520EZZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for OY67%20EZZ: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: AO63%20VPL
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO63%2520VPL%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for AO63%20VPL: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: SJ19%20FLS
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ19%2520FLS%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for SJ19%20FLS: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: SM73%20DNX
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM73%2520DNX%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for SM73%20DNX: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: EA23%20YLO
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA23%2520YLO%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for EA23%20YLO: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: KU63%20WEA
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU63%2520WEA%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for KU63%20WEA: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: WP69%20UHB
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP69%2520UHB%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for WP69%20UHB: 0
2026-03-28 11:09:42 [bca.uk] INFO: Found listing with ID: YS69%20ZKF
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS69%2520ZKF%27 HTTP/1.1" 200 None
2026-03-28 11:09:42 [bca.uk] INFO: Scrape type for YS69%20ZKF: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: YM71%20FSP
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM71%2520FSP%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for YM71%20FSP: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: YS16%20DMO
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS16%2520DMO%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for YS16%20DMO: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: DN13%20XYJ
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN13%2520XYJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for DN13%20XYJ: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: GK24%20HMF
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK24%2520HMF%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for GK24%20HMF: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: WN22%20TKD
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN22%2520TKD%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for WN22%20TKD: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: LO23%20GPU
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO23%2520GPU%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for LO23%20GPU: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: YP68%20XHL
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP68%2520XHL%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for YP68%20XHL: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: YA23%20TZR
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA23%2520TZR%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for YA23%20TZR: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: VN18%20WGJ
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN18%2520WGJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for VN18%20WGJ: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: BN16%20YCC
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520YCC%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for BN16%20YCC: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: EF15%20ECY
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF15%2520ECY%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for EF15%20ECY: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: BV64%20HHP
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV64%2520HHP%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for BV64%20HHP: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: WP22%20CZC
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP22%2520CZC%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for WP22%20CZC: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: YH21%20NLM
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH21%2520NLM%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for YH21%20NLM: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: CE69%20XSY
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE69%2520XSY%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for CE69%20XSY: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: FL68%20XDW
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520XDW%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for FL68%20XDW: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: AO62%20OXD
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO62%2520OXD%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for AO62%20OXD: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: PX56%20GKL
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX56%2520GKL%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for PX56%20GKL: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: MD19%20WYP
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD19%2520WYP%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for MD19%20WYP: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: KE73%20AZL
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE73%2520AZL%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for KE73%20AZL: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: LM72%20ZKZ
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM72%2520ZKZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for LM72%20ZKZ: 0
2026-03-28 11:09:43 [bca.uk] INFO: Found listing with ID: VO24%20OZH
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520OZH%27 HTTP/1.1" 200 None
2026-03-28 11:09:43 [bca.uk] INFO: Scrape type for VO24%20OZH: 2
2026-03-28 11:09:43 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f6006bc6-6a7a-5784-ab2f-35c3c234ee22 with identifier: VO24%20OZH
2026-03-28 11:09:43 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f6006bc6-6a7a-5784-ab2f-35c3c234ee22 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f6006bc6-6a7a-5784-ab2f-35c3c234ee22 with scrape type 2
2026-03-28 11:09:43 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f6006bc6-6a7a-5784-ab2f-35c3c234ee22, identifier: VO24%20OZH
2026-03-28 11:09:43 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:43 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:43 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f6006bc6-6a7a-5784-ab2f-35c3c234ee22 with identifier: VO24%20OZH
2026-03-28 11:09:43 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f6006bc6-6a7a-5784-ab2f-35c3c234ee22 with identifier: VO24%20OZH
2026-03-28 11:09:43 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f6006bc6-6a7a-5784-ab2f-35c3c234ee22 with identifier: VO24%20OZH to the API
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:43 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO24%20OZH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f6006bc6-6a7a-5784-ab2f-35c3c234ee22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VO24 OZH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO24%20OZH&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 7455,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNSTRY515843',
'year': 2024}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520OZH%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [bca.uk] INFO: Saving data for VO24%20OZH: {'auction_closing_time': 1775037600.0, 'created_time': 1773821497.444928, 'last_price_update_time': 1774696184.128585}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO24%2520OZH') HTTP/1.1" 204 0
2026-03-28 11:09:44 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:44 [bca.uk] INFO: Found listing with ID: DK14%20KWN
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK14%2520KWN%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [bca.uk] INFO: Scrape type for DK14%20KWN: 0
2026-03-28 11:09:44 [bca.uk] INFO: Found listing with ID: LR23%20ZDW
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR23%2520ZDW%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [bca.uk] INFO: Scrape type for LR23%20ZDW: 0
2026-03-28 11:09:44 [bca.uk] INFO: Found listing with ID: GV74%20XLD
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV74%2520XLD%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [bca.uk] INFO: Scrape type for GV74%20XLD: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f8d4f97e-ae21-55ad-b049-021e8e1bb310 with identifier: GV74%20XLD
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f8d4f97e-ae21-55ad-b049-021e8e1bb310 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f8d4f97e-ae21-55ad-b049-021e8e1bb310 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f8d4f97e-ae21-55ad-b049-021e8e1bb310, identifier: GV74%20XLD
2026-03-28 11:09:44 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f8d4f97e-ae21-55ad-b049-021e8e1bb310 with identifier: GV74%20XLD
2026-03-28 11:09:44 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f8d4f97e-ae21-55ad-b049-021e8e1bb310 with identifier: GV74%20XLD
2026-03-28 11:09:44 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f8d4f97e-ae21-55ad-b049-021e8e1bb310 with identifier: GV74%20XLD to the API
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:44 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 123,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV74%20XLD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'f8d4f97e-ae21-55ad-b049-021e8e1bb310',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GV74 XLD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV74%20XLD&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 9564,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 MHEV 136 ALLURE E-DSC6 Hatchback',
'transmission': 'automatic',
'trim': 'MHEV 136 ALLURE E-DSC6',
'vin': 'VR3KAHPY5SS014093',
'year': 2025}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV74%2520XLD%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [bca.uk] INFO: Saving data for GV74%20XLD: {'auction_closing_time': 1775124000.0, 'created_time': 1773933733.879725, 'last_price_update_time': 1774696184.886768}
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV74%2520XLD') HTTP/1.1" 204 0
2026-03-28 11:09:44 [bca.uk] INFO: Found listing with ID: LM74%20XOF
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:44 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM74%2520XOF%27 HTTP/1.1" 200 None
2026-03-28 11:09:44 [bca.uk] INFO: Scrape type for LM74%20XOF: 2
2026-03-28 11:09:44 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1 with identifier: LM74%20XOF
2026-03-28 11:09:44 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1 with scrape type 2
2026-03-28 11:09:44 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1, identifier: LM74%20XOF
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1 with identifier: LM74%20XOF
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1 with identifier: LM74%20XOF
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1 with identifier: LM74%20XOF to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LM74%20XOF-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Electric',
'id': '42be7ba9-bbf0-5b5e-a25b-00b3090c6ea1',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LM74 XOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LM74%20XOF&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': 'E-5008',
'odometer': 4178,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT E-5008 157KW 73KWH GT StationWagon',
'transmission': 'automatic',
'trim': '157KW 73KWH GT',
'vin': 'VR3KCZKZ3RS117443',
'year': 2024}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM74%2520XOF%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [bca.uk] INFO: Saving data for LM74%20XOF: {'auction_closing_time': 1775124000.0, 'created_time': 1773835097.617083, 'last_price_update_time': 1774696185.442083}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LM74%2520XOF') HTTP/1.1" 204 0
2026-03-28 11:09:45 [bca.uk] INFO: Found listing with ID: LP72%20VEW
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP72%2520VEW%27 HTTP/1.1" 200 None
2026-03-28 11:09:45 [bca.uk] INFO: Scrape type for LP72%20VEW: 2
2026-03-28 11:09:45 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 73a064e7-d3b7-518d-ae6c-ab784c30dd38 with identifier: LP72%20VEW
2026-03-28 11:09:45 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 73a064e7-d3b7-518d-ae6c-ab784c30dd38 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 73a064e7-d3b7-518d-ae6c-ab784c30dd38 with scrape type 2
2026-03-28 11:09:45 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 73a064e7-d3b7-518d-ae6c-ab784c30dd38, identifier: LP72%20VEW
2026-03-28 11:09:45 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 73a064e7-d3b7-518d-ae6c-ab784c30dd38 with identifier: LP72%20VEW
2026-03-28 11:09:45 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 73a064e7-d3b7-518d-ae6c-ab784c30dd38 with identifier: LP72%20VEW
2026-03-28 11:09:45 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 73a064e7-d3b7-518d-ae6c-ab784c30dd38 with identifier: LP72%20VEW to the API
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:45 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 24,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LP72%20VEW-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '73a064e7-d3b7-518d-ae6c-ab784c30dd38',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LP72 VEW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LP72%20VEW&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 18998,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 PHEV 180 GT E-EAT8 Estate',
'transmission': 'automatic',
'trim': 'PHEV 180 GT E-EAT8',
'vin': 'VR3F4DGXTPY502521',
'year': 2023}
2026-03-28 11:09:45 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP72%2520VEW%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [bca.uk] INFO: Saving data for LP72%20VEW: {'auction_closing_time': 1775124000.0, 'created_time': 1773842002.966412, 'last_price_update_time': 1774696186.012455}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LP72%2520VEW') HTTP/1.1" 204 0
2026-03-28 11:09:46 [bca.uk] INFO: Found listing with ID: MD24%20WCJ
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD24%2520WCJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [bca.uk] INFO: Scrape type for MD24%20WCJ: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7edab048-8793-5e8c-8998-59f82ee7abd8 with identifier: MD24%20WCJ
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7edab048-8793-5e8c-8998-59f82ee7abd8 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7edab048-8793-5e8c-8998-59f82ee7abd8 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7edab048-8793-5e8c-8998-59f82ee7abd8, identifier: MD24%20WCJ
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7edab048-8793-5e8c-8998-59f82ee7abd8 with identifier: MD24%20WCJ
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7edab048-8793-5e8c-8998-59f82ee7abd8 with identifier: MD24%20WCJ
2026-03-28 11:09:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7edab048-8793-5e8c-8998-59f82ee7abd8 with identifier: MD24%20WCJ to the API
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:46 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MD24%20WCJ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7edab048-8793-5e8c-8998-59f82ee7abd8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MD24 WCJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MD24%20WCJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 23671,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.2 P/T 130 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 130 ALLURE',
'vin': 'VR3USHNS3RJ710049',
'year': 2024}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD24%2520WCJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [bca.uk] INFO: Saving data for MD24%20WCJ: {'auction_closing_time': 1775124000.0, 'created_time': 1773841962.181373, 'last_price_update_time': 1774696186.717514}
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MD24%2520WCJ') HTTP/1.1" 204 0
2026-03-28 11:09:46 [bca.uk] INFO: Found listing with ID: BC74%20HAX
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC74%2520HAX%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [bca.uk] INFO: Scrape type for BC74%20HAX: 0
2026-03-28 11:09:46 [bca.uk] INFO: Found listing with ID: EO23%20LML
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO23%2520LML%27 HTTP/1.1" 200 None
2026-03-28 11:09:46 [bca.uk] INFO: Scrape type for EO23%20LML: 2
2026-03-28 11:09:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 68419bff-341b-5d12-ada5-93c0d97b2fa2 with identifier: EO23%20LML
2026-03-28 11:09:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 68419bff-341b-5d12-ada5-93c0d97b2fa2 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 68419bff-341b-5d12-ada5-93c0d97b2fa2 with scrape type 2
2026-03-28 11:09:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 68419bff-341b-5d12-ada5-93c0d97b2fa2, identifier: EO23%20LML
2026-03-28 11:09:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 68419bff-341b-5d12-ada5-93c0d97b2fa2 with identifier: EO23%20LML
2026-03-28 11:09:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 68419bff-341b-5d12-ada5-93c0d97b2fa2 with identifier: EO23%20LML
2026-03-28 11:09:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 68419bff-341b-5d12-ada5-93c0d97b2fa2 with identifier: EO23%20LML to the API
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EO23%20LML-GB',
'category': 'Car',
'color': 'yellow',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Electric',
'id': '68419bff-341b-5d12-ada5-93c0d97b2fa2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'EO23 LML',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EO23%20LML&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'PEUGEOT',
'model': 'E-208',
'odometer': 8835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'PEUGEOT E-208 100KW 50KWH GT Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH GT',
'vin': 'VR3UHZKXZPT512915',
'year': 2023}
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO23%2520LML%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Saving data for EO23%20LML: {'auction_closing_time': 1775124000.0, 'created_time': 1773842001.936317, 'last_price_update_time': 1774696187.331557}
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EO23%2520LML') HTTP/1.1" 204 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: EU16%20VPP
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU16%2520VPP%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for EU16%20VPP: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: EO74%20OPL
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO74%2520OPL%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for EO74%20OPL: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: DA15%20KME
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA15%2520KME%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for DA15%20KME: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: DN17%20OTR
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN17%2520OTR%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for DN17%20OTR: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: LL23%20KPF
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL23%2520KPF%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for LL23%20KPF: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: Y863%20PSL
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y863%2520PSL%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for Y863%20PSL: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: FY72%20ATU
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY72%2520ATU%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for FY72%20ATU: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: SR19%20KRE
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR19%2520KRE%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for SR19%20KRE: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: AX72%20JJV
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520JJV%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for AX72%20JJV: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: AF21%20VSG
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF21%2520VSG%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for AF21%20VSG: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: DX23%20TSO
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX23%2520TSO%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for DX23%20TSO: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: KN69%20NPV
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN69%2520NPV%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for KN69%20NPV: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: YF72%20VKM
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF72%2520VKM%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for YF72%20VKM: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: DY72%20BZT
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY72%2520BZT%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for DY72%20BZT: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: P123%20PJG
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P123%2520PJG%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for P123%20PJG: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: AO22%20TKN
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO22%2520TKN%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for AO22%20TKN: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: AX72%20KAU
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520KAU%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for AX72%20KAU: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: GY21%20ECT
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY21%2520ECT%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for GY21%20ECT: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: GC23%20CTV
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC23%2520CTV%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for GC23%20CTV: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: YF68%20ZTR
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF68%2520ZTR%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for YF68%20ZTR: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: GV24%20ECT
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV24%2520ECT%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for GV24%20ECT: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: GY23%20TYF
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY23%2520TYF%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for GY23%20TYF: 0
2026-03-28 11:09:47 [bca.uk] INFO: Found listing with ID: WU18%20RYO
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU18%2520RYO%27 HTTP/1.1" 200 None
2026-03-28 11:09:47 [bca.uk] INFO: Scrape type for WU18%20RYO: 2
2026-03-28 11:09:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 87074d6b-22d8-5855-8f29-a1906723cba7 with identifier: WU18%20RYO
2026-03-28 11:09:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 87074d6b-22d8-5855-8f29-a1906723cba7 with scrape type 2
2026-03-28 11:09:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 87074d6b-22d8-5855-8f29-a1906723cba7 with scrape type 2
2026-03-28 11:09:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 87074d6b-22d8-5855-8f29-a1906723cba7, identifier: WU18%20RYO
2026-03-28 11:09:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 87074d6b-22d8-5855-8f29-a1906723cba7 with identifier: WU18%20RYO
2026-03-28 11:09:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 87074d6b-22d8-5855-8f29-a1906723cba7 with identifier: WU18%20RYO
2026-03-28 11:09:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 87074d6b-22d8-5855-8f29-a1906723cba7 with identifier: WU18%20RYO to the API
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:09:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=15&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 135,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WU18%20RYO-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Diesel',
'id': '87074d6b-22d8-5855-8f29-a1906723cba7',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WU18 RYO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WU18%20RYO&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'FORD',
'model': 'KUGA',
'odometer': 74876,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2018-01-01',
'seller_name': None,
'title': 'FORD KUGA 2.0 TDCI 180 4WD TITANIUM StationWagon',
'transmission': 'manual',
'trim': 'TDCI 180 4WD TITANIUM',
'vin': 'WF0AXXWPMAJY81656',
'year': 2018}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU18%2520RYO%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Saving data for WU18%20RYO: {'auction_closing_time': 1775037600.0, 'created_time': 1774276679.237575, 'last_price_update_time': 1774696188.352052}
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WU18%2520RYO') HTTP/1.1" 204 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: OV71%20KBY
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV71%2520KBY%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for OV71%20KBY: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: KV72%20VJL
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV72%2520VJL%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for KV72%20VJL: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: VO17%20JDK
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520JDK%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for VO17%20JDK: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: OV21%20JZF
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV21%2520JZF%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for OV21%20JZF: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: DU20%20NZO
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU20%2520NZO%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for DU20%20NZO: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: VK72%20WFR
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK72%2520WFR%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for VK72%20WFR: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: GD20%20BRZ
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD20%2520BRZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for GD20%20BRZ: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: FM19%20TZB
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM19%2520TZB%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for FM19%20TZB: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: HJ23%20YHS
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ23%2520YHS%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for HJ23%20YHS: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: KT68%20ENX
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT68%2520ENX%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for KT68%20ENX: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: FV18%20YDD
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV18%2520YDD%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for FV18%20YDD: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: KD16%20EZL
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KD16%2520EZL%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for KD16%20EZL: 0
2026-03-28 11:09:48 [bca.uk] INFO: Found listing with ID: YS63%20PYT
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS63%2520PYT%27 HTTP/1.1" 200 None
2026-03-28 11:09:48 [bca.uk] INFO: Scrape type for YS63%20PYT: 0
2026-03-28 11:09:54 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=16&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:55 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:55 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded
2026-03-28 11:09:55 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YS08%20YXV
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS08%2520YXV%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YS08%20YXV: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YS08%20ZJO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS08%2520ZJO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YS08%20ZJO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: EK71%20HZV
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK71%2520HZV%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for EK71%20HZV: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: BT67%20OWK
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT67%2520OWK%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for BT67%20OWK: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: RX65%20HHD
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX65%2520HHD%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for RX65%20HHD: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: VO68%20DSX
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO68%2520DSX%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for VO68%20DSX: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YO19%20YDJ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO19%2520YDJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YO19%20YDJ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: KR18%20BKJ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR18%2520BKJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for KR18%20BKJ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: WU13%20UEB
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU13%2520UEB%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for WU13%20UEB: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YN15%20UFJ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN15%2520UFJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YN15%20UFJ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: LS17%20GEO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS17%2520GEO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for LS17%20GEO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: SH14%20WXM
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH14%2520WXM%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for SH14%20WXM: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: FX63%20YEF
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX63%2520YEF%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for FX63%20YEF: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: FP65%20TEO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520TEO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for FP65%20TEO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: AV68%20GXP
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV68%2520GXP%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for AV68%20GXP: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: SC68%20NNM
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC68%2520NNM%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for SC68%20NNM: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: MK61%20GYH
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520GYH%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for MK61%20GYH: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: FV08%20DGX
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV08%2520DGX%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for FV08%20DGX: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: FG18%20GHU
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG18%2520GHU%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for FG18%20GHU: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: FG64%20LKJ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520LKJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for FG64%20LKJ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: WX17%20XDB
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX17%2520XDB%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for WX17%20XDB: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YF68%20LHH
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF68%2520LHH%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YF68%20LHH: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YC17%20AVU
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520AVU%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YC17%20AVU: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: LV62%20VKA
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV62%2520VKA%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for LV62%20VKA: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: MT14%20SOU
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for MT14%20SOU: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NG63%20RMZ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG63%2520RMZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NG63%20RMZ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: VU66%20URO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU66%2520URO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for VU66%20URO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: GX14%20TLV
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX14%2520TLV%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for GX14%20TLV: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NA64%20UVD
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA64%2520UVD%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NA64%20UVD: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NJ12%20XTN
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ12%2520XTN%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NJ12%20XTN: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: VN14%20HVP
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN14%2520HVP%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for VN14%20HVP: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NV66%20ZTE
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV66%2520ZTE%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NV66%20ZTE: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: BF65%20FCL
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520FCL%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for BF65%20FCL: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: CE63%20PBY
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE63%2520PBY%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for CE63%20PBY: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YY59%20CYA
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY59%2520CYA%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YY59%20CYA: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: HV67%20RZT
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV67%2520RZT%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for HV67%20RZT: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: GJ60%20KJA
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ60%2520KJA%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for GJ60%20KJA: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: SB60%20CNO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB60%2520CNO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for SB60%20CNO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: YP06%20NXZ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP06%2520NXZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for YP06%20NXZ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: EJ66%20XPA
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ66%2520XPA%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for EJ66%20XPA: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: BK13%20TGJ
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK13%2520TGJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for BK13%20TGJ: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NU14%20YFL
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU14%2520YFL%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NU14%20YFL: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: SK12%20HUV
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK12%2520HUV%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for SK12%20HUV: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NU68%20WCD
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU68%2520WCD%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NU68%20WCD: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NV11%20BAO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV11%2520BAO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NV11%20BAO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NX63%20OSO
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX63%2520OSO%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NX63%20OSO: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: NU66%20UWF
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU66%2520UWF%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for NU66%20UWF: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: OV19%20NWU
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV19%2520NWU%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for OV19%20NWU: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: DS65%20WCC
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520WCC%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for DS65%20WCC: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: ND12%20FCP
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND12%2520FCP%27 HTTP/1.1" 200 None
2026-03-28 11:09:55 [bca.uk] INFO: Scrape type for ND12%20FCP: 0
2026-03-28 11:09:55 [bca.uk] INFO: Found listing with ID: VO11%20WKT
2026-03-28 11:09:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO11%2520WKT%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for VO11%20WKT: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SJ15%20VEV
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520VEV%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SJ15%20VEV: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: ND13%20HSY
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND13%2520HSY%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for ND13%20HSY: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: ND15%20SFU
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520SFU%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for ND15%20SFU: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: ND53%20EJZ
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND53%2520EJZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for ND53%20EJZ: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SL10%20HRP
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL10%2520HRP%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SL10%20HRP: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: FE64%20FGV
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520FGV%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for FE64%20FGV: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: A13%20MVN
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27A13%2520MVN%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for A13%20MVN: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: AK17%20GUU
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520GUU%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for AK17%20GUU: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NG15%20FSV
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG15%2520FSV%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NG15%20FSV: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NX64%20XJU
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX64%2520XJU%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NX64%20XJU: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: PX17%20KLK
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX17%2520KLK%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for PX17%20KLK: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: XJZ%202720
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27XJZ%25202720%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for XJZ%202720: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: YB66%20XOJ
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520XOJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for YB66%20XOJ: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SB63%20LBV
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB63%2520LBV%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SB63%20LBV: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NG09%20OHE
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG09%2520OHE%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NG09%20OHE: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NL14%20EJE
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL14%2520EJE%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NL14%20EJE: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NL64%20FPJ
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520FPJ%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NL64%20FPJ: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SN13%20ZFP
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN13%2520ZFP%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SN13%20ZFP: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SD20%20GGV
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD20%2520GGV%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SD20%20GGV: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: DT70%20EYC
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DT70%2520EYC%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for DT70%20EYC: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NG17%20OYT
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG17%2520OYT%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NG17%20OYT: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: RV12%20YXK
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV12%2520YXK%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for RV12%20YXK: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SG16%20NZO
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520NZO%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SG16%20NZO: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: SH63%20LDY
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH63%2520LDY%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for SH63%20LDY: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: NJ58%20LNC
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ58%2520LNC%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for NJ58%20LNC: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: AF70%20ZNZ
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF70%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for AF70%20ZNZ: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: HK66%20JFA
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JFA%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for HK66%20JFA: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: PN64%20HCG
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN64%2520HCG%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for PN64%20HCG: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: YA17%20WGF
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA17%2520WGF%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for YA17%20WGF: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: DV65%20WKF
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV65%2520WKF%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for DV65%20WKF: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: KU66%20ZTZ
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU66%2520ZTZ%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for KU66%20ZTZ: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: YR66%20PXG
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR66%2520PXG%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for YR66%20PXG: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: AO65%20UZE
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520UZE%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for AO65%20UZE: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: FA15%20RVP
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FA15%2520RVP%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for FA15%20RVP: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: AY18%20HNV
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY18%2520HNV%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for AY18%20HNV: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: LL66%20FWD
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL66%2520FWD%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for LL66%20FWD: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: AO10%20TKU
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO10%2520TKU%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for AO10%20TKU: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: WG17%20UXC
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG17%2520UXC%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for WG17%20UXC: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: YK59%20SRO
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK59%2520SRO%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for YK59%20SRO: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: WF67%20DFL
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF67%2520DFL%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for WF67%20DFL: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: RX72%20LTT
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX72%2520LTT%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for RX72%20LTT: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: FV10%20XXD
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV10%2520XXD%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for FV10%20XXD: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: WK61%20ZTU
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520ZTU%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for WK61%20ZTU: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: BU18%20NGO
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU18%2520NGO%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for BU18%20NGO: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: RO63%20YYB
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO63%2520YYB%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for RO63%20YYB: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: OW15%20CWM
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW15%2520CWM%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for OW15%20CWM: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: WD21%20HYN
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD21%2520HYN%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for WD21%20HYN: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: VN64%20GJE
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN64%2520GJE%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for VN64%20GJE: 0
2026-03-28 11:09:56 [bca.uk] INFO: Found listing with ID: WA22%20OGO
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:56 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA22%2520OGO%27 HTTP/1.1" 200 None
2026-03-28 11:09:56 [bca.uk] INFO: Scrape type for WA22%20OGO: 0
2026-03-28 11:09:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:56 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:56 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:09:59 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:09:59 [bca.uk] INFO: Total items found: 100
2026-03-28 11:09:59 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded
2026-03-28 11:09:59 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:09:59 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: WF63%20PZN
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF63%2520PZN%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for WF63%20PZN: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: CF16%20VCC
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF16%2520VCC%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for CF16%20VCC: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: YF23%20UNU
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UNU%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for YF23%20UNU: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: CE67%20DUA
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE67%2520DUA%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for CE67%20DUA: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: VA15%20PGV
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA15%2520PGV%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for VA15%20PGV: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: WF62%20FHV
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF62%2520FHV%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for WF62%20FHV: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: WP64%20OMX
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP64%2520OMX%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for WP64%20OMX: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: KT17%20GKL
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT17%2520GKL%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for KT17%20GKL: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: HP08%20CJP
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HP08%2520CJP%27 HTTP/1.1" 200 None
2026-03-28 11:09:59 [bca.uk] INFO: Scrape type for HP08%20CJP: 0
2026-03-28 11:09:59 [bca.uk] INFO: Found listing with ID: SG15%20DHC
2026-03-28 11:09:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG15%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for SG15%20DHC: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: FD17%20YNY
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD17%2520YNY%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for FD17%20YNY: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: WR62%20NLM
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520NLM%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for WR62%20NLM: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: NA14%20BWZ
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520BWZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for NA14%20BWZ: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: BD03%20HWG
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD03%2520HWG%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for BD03%20HWG: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: BG68%20PDX
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG68%2520PDX%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for BG68%20PDX: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: OE04%20DZX
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE04%2520DZX%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for OE04%20DZX: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: VO64%20EHR
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO64%2520EHR%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for VO64%20EHR: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: ND63%20LNP
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND63%2520LNP%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for ND63%20LNP: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: SL64%20FZK
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL64%2520FZK%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for SL64%20FZK: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: AU56%20WCK
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU56%2520WCK%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for AU56%20WCK: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: FM56%20CRV
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FM56%2520CRV%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for FM56%20CRV: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: ML67%20ONM
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML67%2520ONM%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for ML67%20ONM: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: PK17%20EOC
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK17%2520EOC%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for PK17%20EOC: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: YC68%20CCO
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520CCO%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for YC68%20CCO: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: YK19%20YDN
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK19%2520YDN%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for YK19%20YDN: 0
2026-03-28 11:10:00 [bca.uk] INFO: Found listing with ID: VO24%20YPP
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520YPP%27 HTTP/1.1" 200 None
2026-03-28 11:10:00 [bca.uk] INFO: Scrape type for VO24%20YPP: 2
2026-03-28 11:10:00 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: dac4ecb8-e136-5a0c-8432-4ccd50af8946 with identifier: VO24%20YPP
2026-03-28 11:10:00 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item dac4ecb8-e136-5a0c-8432-4ccd50af8946 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item dac4ecb8-e136-5a0c-8432-4ccd50af8946 with scrape type 2
2026-03-28 11:10:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: dac4ecb8-e136-5a0c-8432-4ccd50af8946, identifier: VO24%20YPP
2026-03-28 11:10:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:00 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: dac4ecb8-e136-5a0c-8432-4ccd50af8946 with identifier: VO24%20YPP
2026-03-28 11:10:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: dac4ecb8-e136-5a0c-8432-4ccd50af8946 with identifier: VO24%20YPP
2026-03-28 11:10:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: dac4ecb8-e136-5a0c-8432-4ccd50af8946 with identifier: VO24%20YPP to the API
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO24%20YPP-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-03T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'dac4ecb8-e136-5a0c-8432-4ccd50af8946',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VO24 YPP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO24%20YPP&vehicleType=*',
'listing': 'auction',
'location': 'Wolverhampton',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 26041,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNSTRY518836',
'year': 2024}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520YPP%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Saving data for VO24%20YPP: {'auction_closing_time': 1775210400.0, 'created_time': 1773842138.323411, 'last_price_update_time': 1774696201.059455}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO24%2520YPP') HTTP/1.1" 204 0
2026-03-28 11:10:01 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: SL63%20OXM
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL63%2520OXM%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for SL63%20OXM: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: YH63%20SRO
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH63%2520SRO%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for YH63%20SRO: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: OY16%20GVN
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY16%2520GVN%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for OY16%20GVN: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: YD16%20XEJ
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD16%2520XEJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for YD16%20XEJ: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: VO24%20ONM
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520ONM%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for VO24%20ONM: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0 with identifier: VO24%20ONM
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0 with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0, identifier: VO24%20ONM
2026-03-28 11:10:01 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0 with identifier: VO24%20ONM
2026-03-28 11:10:01 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0 with identifier: VO24%20ONM
2026-03-28 11:10:01 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0 with identifier: VO24%20ONM to the API
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:01 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO24%20ONM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7ff5d5e5-d7ad-5c5b-a68e-94dd745e25f0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VO24 ONM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO24%20ONM&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 7175,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNSTRY514077',
'year': 2024}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520ONM%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Saving data for VO24%20ONM: {'auction_closing_time': 1775037600.0, 'created_time': 1773844909.696212, 'last_price_update_time': 1774696201.805746}
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO24%2520ONM') HTTP/1.1" 204 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: YB17%20SGV
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB17%2520SGV%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for YB17%20SGV: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: MW54%20PAS
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW54%2520PAS%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for MW54%20PAS: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: CK18%20CFX
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520CFX%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for CK18%20CFX: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: DF64%20XZL
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF64%2520XZL%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for DF64%20XZL: 0
2026-03-28 11:10:01 [bca.uk] INFO: Found listing with ID: VN24%20OFL
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN24%2520OFL%27 HTTP/1.1" 200 None
2026-03-28 11:10:01 [bca.uk] INFO: Scrape type for VN24%20OFL: 2
2026-03-28 11:10:01 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: fff08332-9ec1-5103-91bd-3271bc97682d with identifier: VN24%20OFL
2026-03-28 11:10:01 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item fff08332-9ec1-5103-91bd-3271bc97682d with scrape type 2
2026-03-28 11:10:01 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item fff08332-9ec1-5103-91bd-3271bc97682d with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: fff08332-9ec1-5103-91bd-3271bc97682d, identifier: VN24%20OFL
2026-03-28 11:10:02 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: fff08332-9ec1-5103-91bd-3271bc97682d with identifier: VN24%20OFL
2026-03-28 11:10:02 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: fff08332-9ec1-5103-91bd-3271bc97682d with identifier: VN24%20OFL
2026-03-28 11:10:02 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: fff08332-9ec1-5103-91bd-3271bc97682d with identifier: VN24%20OFL to the API
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:02 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VN24%20OFL-GB',
'category': 'Car',
'color': 'green',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'fff08332-9ec1-5103-91bd-3271bc97682d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VN24 OFL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VN24%20OFL&vehicleType=*',
'listing': 'auction',
'location': 'Walsall',
'make': 'PEUGEOT',
'model': '308',
'odometer': 12415,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VR3FPHNSTRY558519',
'year': 2024}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN24%2520OFL%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Saving data for VN24%20OFL: {'auction_closing_time': 1775124000.0, 'created_time': 1773843548.099658, 'last_price_update_time': 1774696202.441204}
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VN24%2520OFL') HTTP/1.1" 204 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: DV18%20UGL
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV18%2520UGL%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for DV18%20UGL: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: PF68%20UBR
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF68%2520UBR%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for PF68%20UBR: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: FG64%20CDE
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG64%2520CDE%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for FG64%20CDE: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: RX66%20PZR
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX66%2520PZR%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for RX66%20PZR: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: VO15%20ZYX
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO15%2520ZYX%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for VO15%20ZYX: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: CA65%20XLF
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA65%2520XLF%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for CA65%20XLF: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: FG17%20UWY
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG17%2520UWY%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for FG17%20UWY: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: RV10%20KSE
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV10%2520KSE%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for RV10%20KSE: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: RJ74%20TCK
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ74%2520TCK%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for RJ74%20TCK: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: ML24%20FDM
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML24%2520FDM%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for ML24%20FDM: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: MW74%20DCV
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DCV%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for MW74%20DCV: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: AF66%20ZRY
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF66%2520ZRY%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for AF66%20ZRY: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: CT19%20VYM
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CT19%2520VYM%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for CT19%20VYM: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: LB69%20LHJ
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB69%2520LHJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for LB69%20LHJ: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: WT18%20AFV
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT18%2520AFV%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for WT18%20AFV: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: GB07%20RWC
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GB07%2520RWC%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for GB07%20RWC: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: BG16%20LZX
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520LZX%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for BG16%20LZX: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: BJ15%20TGX
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ15%2520TGX%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for BJ15%20TGX: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: HJ14%20NWA
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ14%2520NWA%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for HJ14%20NWA: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: LA17%20FSO
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA17%2520FSO%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for LA17%20FSO: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: LY14%20ERJ
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY14%2520ERJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for LY14%20ERJ: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: NK16%20WBZ
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK16%2520WBZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for NK16%20WBZ: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: MD74%20GVX
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD74%2520GVX%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for MD74%20GVX: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: MW74%20DWK
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWK%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for MW74%20DWK: 0
2026-03-28 11:10:02 [bca.uk] INFO: Found listing with ID: VK24%20OHL
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:02 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK24%2520OHL%27 HTTP/1.1" 200 None
2026-03-28 11:10:02 [bca.uk] INFO: Scrape type for VK24%20OHL: 2
2026-03-28 11:10:02 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ab411977-bc96-5410-a944-59210d9c5f22 with identifier: VK24%20OHL
2026-03-28 11:10:02 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ab411977-bc96-5410-a944-59210d9c5f22 with scrape type 2
2026-03-28 11:10:02 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ab411977-bc96-5410-a944-59210d9c5f22 with scrape type 2
2026-03-28 11:10:03 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ab411977-bc96-5410-a944-59210d9c5f22, identifier: VK24%20OHL
2026-03-28 11:10:03 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ab411977-bc96-5410-a944-59210d9c5f22 with identifier: VK24%20OHL
2026-03-28 11:10:03 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ab411977-bc96-5410-a944-59210d9c5f22 with identifier: VK24%20OHL
2026-03-28 11:10:03 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ab411977-bc96-5410-a944-59210d9c5f22 with identifier: VK24%20OHL to the API
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:03 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=17&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK24%20OHL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'ab411977-bc96-5410-a944-59210d9c5f22',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VK24 OHL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK24%20OHL&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 7456,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNSXRY535364',
'year': 2024}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK24%2520OHL%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Saving data for VK24%20OHL: {'auction_closing_time': 1775037600.0, 'created_time': 1773834894.87429, 'last_price_update_time': 1774696203.476969}
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK24%2520OHL') HTTP/1.1" 204 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: WU66%20YYE
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU66%2520YYE%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for WU66%20YYE: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: SV65%20YEU
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV65%2520YEU%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for SV65%20YEU: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: GK64%20CWW
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK64%2520CWW%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for GK64%20CWW: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: NA64%20WUD
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA64%2520WUD%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for NA64%20WUD: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: SB14%20EVY
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB14%2520EVY%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for SB14%20EVY: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: DU14%20WPP
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU14%2520WPP%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for DU14%20WPP: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: SY16%20OXD
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY16%2520OXD%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for SY16%20OXD: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: VK16%20VFS
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK16%2520VFS%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for VK16%20VFS: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: YE66%20NZJ
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE66%2520NZJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for YE66%20NZJ: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: YY66%20PPX
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY66%2520PPX%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for YY66%20PPX: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: BD64%20BTV
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520BTV%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for BD64%20BTV: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: JA06%20MCR
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JA06%2520MCR%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for JA06%20MCR: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: KY66%20CUX
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY66%2520CUX%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for KY66%20CUX: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: LD19%20UEV
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD19%2520UEV%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for LD19%20UEV: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: PK19%20YDR
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK19%2520YDR%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for PK19%20YDR: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: R29%20OMM
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27R29%2520OMM%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for R29%20OMM: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: SJ15%20ZWE
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ15%2520ZWE%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for SJ15%20ZWE: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: SP64%20OPY
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:03 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP64%2520OPY%27 HTTP/1.1" 200 None
2026-03-28 11:10:03 [bca.uk] INFO: Scrape type for SP64%20OPY: 0
2026-03-28 11:10:03 [bca.uk] INFO: Found listing with ID: VE16%20WMP
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE16%2520WMP%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for VE16%20WMP: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: NV73%20GTZ
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV73%2520GTZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for NV73%20GTZ: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: DA66%20BXD
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520BXD%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for DA66%20BXD: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: VA19%20HFN
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA19%2520HFN%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for VA19%20HFN: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: SV15%20WNG
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV15%2520WNG%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for SV15%20WNG: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: SV16%20YLZ
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV16%2520YLZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for SV16%20YLZ: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: VO17%20HSY
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO17%2520HSY%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for VO17%20HSY: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: WD18%20XLJ
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD18%2520XLJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for WD18%20XLJ: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: MT59%20YVK
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT59%2520YVK%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for MT59%20YVK: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: PN16%20UZP
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN16%2520UZP%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for PN16%20UZP: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: VK10%20KPJ
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK10%2520KPJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for VK10%20KPJ: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: YE67%20KRX
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE67%2520KRX%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for YE67%20KRX: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: BL68%20LXP
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL68%2520LXP%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for BL68%20LXP: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: CV69%20XUM
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV69%2520XUM%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for CV69%20XUM: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: FV64%20AUX
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520AUX%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for FV64%20AUX: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: RX66%20YGF
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX66%2520YGF%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for RX66%20YGF: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: BX65%20XZP
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX65%2520XZP%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for BX65%20XZP: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: HY17%20KLO
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY17%2520KLO%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for HY17%20KLO: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: YH59%20GXB
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520GXB%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for YH59%20GXB: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: NX70%20KFF
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX70%2520KFF%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for NX70%20KFF: 0
2026-03-28 11:10:04 [bca.uk] INFO: Found listing with ID: YS14%20XLG
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:04 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS14%2520XLG%27 HTTP/1.1" 200 None
2026-03-28 11:10:04 [bca.uk] INFO: Scrape type for YS14%20XLG: 0
2026-03-28 11:10:06 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:10:06 [bca.uk] INFO: Total items found: 100
2026-03-28 11:10:06 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded
2026-03-28 11:10:06 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:10:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:06 [bca.uk] INFO: Found listing with ID: BD24%20OJP
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD24%2520OJP%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [bca.uk] INFO: Scrape type for BD24%20OJP: 0
2026-03-28 11:10:06 [bca.uk] INFO: Found listing with ID: BV60%20VXT
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV60%2520VXT%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [bca.uk] INFO: Scrape type for BV60%20VXT: 0
2026-03-28 11:10:06 [bca.uk] INFO: Found listing with ID: BX68%20WYV
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX68%2520WYV%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [bca.uk] INFO: Scrape type for BX68%20WYV: 0
2026-03-28 11:10:06 [bca.uk] INFO: Found listing with ID: FP13%20WNN
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP13%2520WNN%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [bca.uk] INFO: Scrape type for FP13%20WNN: 0
2026-03-28 11:10:06 [bca.uk] INFO: Found listing with ID: LS24%20EXV
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520EXV%27 HTTP/1.1" 200 None
2026-03-28 11:10:06 [bca.uk] INFO: Scrape type for LS24%20EXV: 2
2026-03-28 11:10:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: af32816f-1c01-5083-bcb1-b55141e24caa with identifier: LS24%20EXV
2026-03-28 11:10:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item af32816f-1c01-5083-bcb1-b55141e24caa with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item af32816f-1c01-5083-bcb1-b55141e24caa with scrape type 2
2026-03-28 11:10:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: af32816f-1c01-5083-bcb1-b55141e24caa, identifier: LS24%20EXV
2026-03-28 11:10:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:06 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: af32816f-1c01-5083-bcb1-b55141e24caa with identifier: LS24%20EXV
2026-03-28 11:10:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: af32816f-1c01-5083-bcb1-b55141e24caa with identifier: LS24%20EXV
2026-03-28 11:10:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: af32816f-1c01-5083-bcb1-b55141e24caa with identifier: LS24%20EXV to the API
2026-03-28 11:10:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS24%20EXV-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'af32816f-1c01-5083-bcb1-b55141e24caa',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LS24 EXV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LS24%20EXV&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 9504,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNSTRY514958',
'year': 2024}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520EXV%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [bca.uk] INFO: Saving data for LS24%20EXV: {'auction_closing_time': 1775037600.0, 'created_time': 1774004550.165575, 'last_price_update_time': 1774696207.22749}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LS24%2520EXV') HTTP/1.1" 204 0
2026-03-28 11:10:07 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:07 [bca.uk] INFO: Found listing with ID: MK24%20ZBW
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK24%2520ZBW%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [bca.uk] INFO: Scrape type for MK24%20ZBW: 2
2026-03-28 11:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bbe748c8-84b6-5d76-8015-27874a4d59a5 with identifier: MK24%20ZBW
2026-03-28 11:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bbe748c8-84b6-5d76-8015-27874a4d59a5 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bbe748c8-84b6-5d76-8015-27874a4d59a5 with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bbe748c8-84b6-5d76-8015-27874a4d59a5, identifier: MK24%20ZBW
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bbe748c8-84b6-5d76-8015-27874a4d59a5 with identifier: MK24%20ZBW
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bbe748c8-84b6-5d76-8015-27874a4d59a5 with identifier: MK24%20ZBW
2026-03-28 11:10:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bbe748c8-84b6-5d76-8015-27874a4d59a5 with identifier: MK24%20ZBW to the API
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK24%20ZBW-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bbe748c8-84b6-5d76-8015-27874a4d59a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MK24 ZBW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK24%20ZBW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 19719,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VR3FPHNS0RY520629',
'year': 2024}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK24%2520ZBW%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [bca.uk] INFO: Saving data for MK24%20ZBW: {'auction_closing_time': 1775037600.0, 'created_time': 1774004544.957712, 'last_price_update_time': 1774696207.818544}
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK24%2520ZBW') HTTP/1.1" 204 0
2026-03-28 11:10:07 [bca.uk] INFO: Found listing with ID: MW74%20DWM
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWM%27 HTTP/1.1" 200 None
2026-03-28 11:10:07 [bca.uk] INFO: Scrape type for MW74%20DWM: 2
2026-03-28 11:10:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: a6a2986f-1152-5ae2-b239-ec6a9e57ae0a with identifier: MW74%20DWM
2026-03-28 11:10:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item a6a2986f-1152-5ae2-b239-ec6a9e57ae0a with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item a6a2986f-1152-5ae2-b239-ec6a9e57ae0a with scrape type 2
2026-03-28 11:10:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: a6a2986f-1152-5ae2-b239-ec6a9e57ae0a, identifier: MW74%20DWM
2026-03-28 11:10:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: a6a2986f-1152-5ae2-b239-ec6a9e57ae0a with identifier: MW74%20DWM
2026-03-28 11:10:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: a6a2986f-1152-5ae2-b239-ec6a9e57ae0a with identifier: MW74%20DWM
2026-03-28 11:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: a6a2986f-1152-5ae2-b239-ec6a9e57ae0a with identifier: MW74%20DWM to the API
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW74%20DWM-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'a6a2986f-1152-5ae2-b239-ec6a9e57ae0a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MW74 DWM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MW74%20DWM&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '208',
'odometer': 6112,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 100 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 100 ALLURE',
'vin': 'VR3UPHNE7R4306066',
'year': 2024}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWM%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Saving data for MW74%20DWM: {'auction_closing_time': 1775037600.0, 'created_time': 1773821488.83745, 'last_price_update_time': 1774696208.329176}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MW74%2520DWM') HTTP/1.1" 204 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: MW74%20DWY
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWY%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for MW74%20DWY: 2
2026-03-28 11:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: e2d68c38-6d2f-53cd-8725-215f4892a16a with identifier: MW74%20DWY
2026-03-28 11:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item e2d68c38-6d2f-53cd-8725-215f4892a16a with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item e2d68c38-6d2f-53cd-8725-215f4892a16a with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: e2d68c38-6d2f-53cd-8725-215f4892a16a, identifier: MW74%20DWY
2026-03-28 11:10:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: e2d68c38-6d2f-53cd-8725-215f4892a16a with identifier: MW74%20DWY
2026-03-28 11:10:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: e2d68c38-6d2f-53cd-8725-215f4892a16a with identifier: MW74%20DWY
2026-03-28 11:10:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: e2d68c38-6d2f-53cd-8725-215f4892a16a with identifier: MW74%20DWY to the API
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MW74%20DWY-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'e2d68c38-6d2f-53cd-8725-215f4892a16a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MW74 DWY',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MW74%20DWY&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '208',
'odometer': 6860,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 100 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 100 ALLURE',
'vin': 'VR3UPHNE8R4306061',
'year': 2024}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DWY%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Saving data for MW74%20DWY: {'auction_closing_time': 1775037600.0, 'created_time': 1773821480.065819, 'last_price_update_time': 1774696208.801973}
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MW74%2520DWY') HTTP/1.1" 204 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: AE16%20SPZ
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE16%2520SPZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for AE16%20SPZ: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: FD16%20VWM
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD16%2520VWM%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for FD16%20VWM: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: GN65%20TBO
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN65%2520TBO%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for GN65%20TBO: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: MJ66%20SUX
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ66%2520SUX%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for MJ66%20SUX: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: MT15%20AUN
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT15%2520AUN%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for MT15%20AUN: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: N99%20CYS
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N99%2520CYS%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for N99%20CYS: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: ND66%20MOV
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND66%2520MOV%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for ND66%20MOV: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: OY64%20CEU
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY64%2520CEU%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for OY64%20CEU: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: PX15%20ZRE
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX15%2520ZRE%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for PX15%20ZRE: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: VF15%20MWC
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF15%2520MWC%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for VF15%20MWC: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: LS62%20KHW
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS62%2520KHW%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for LS62%20KHW: 0
2026-03-28 11:10:08 [bca.uk] INFO: Found listing with ID: MJ74%20PBU
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ74%2520PBU%27 HTTP/1.1" 200 None
2026-03-28 11:10:08 [bca.uk] INFO: Scrape type for MJ74%20PBU: 2
2026-03-28 11:10:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 991a9db3-870f-5aa3-b4cc-8e133bd85f20 with identifier: MJ74%20PBU
2026-03-28 11:10:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 991a9db3-870f-5aa3-b4cc-8e133bd85f20 with scrape type 2
2026-03-28 11:10:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 991a9db3-870f-5aa3-b4cc-8e133bd85f20 with scrape type 2
2026-03-28 11:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 991a9db3-870f-5aa3-b4cc-8e133bd85f20, identifier: MJ74%20PBU
2026-03-28 11:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 991a9db3-870f-5aa3-b4cc-8e133bd85f20 with identifier: MJ74%20PBU
2026-03-28 11:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 991a9db3-870f-5aa3-b4cc-8e133bd85f20 with identifier: MJ74%20PBU
2026-03-28 11:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 991a9db3-870f-5aa3-b4cc-8e133bd85f20 with identifier: MJ74%20PBU to the API
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:09 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MJ74%20PBU-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '991a9db3-870f-5aa3-b4cc-8e133bd85f20',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MJ74 PBU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MJ74%20PBU&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 10164,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.2 MHEV 136 ALLURE E-DSC6 StationWagon',
'transmission': 'automatic',
'trim': 'MHEV 136 ALLURE E-DSC6',
'vin': 'VR3KAHPY8RS115820',
'year': 2024}
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ74%2520PBU%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [bca.uk] INFO: Saving data for MJ74%20PBU: {'auction_closing_time': 1775124000.0, 'created_time': 1773841982.061269, 'last_price_update_time': 1774696209.445566}
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MJ74%2520PBU') HTTP/1.1" 204 0
2026-03-28 11:10:09 [bca.uk] INFO: Found listing with ID: MK74%20HBP
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK74%2520HBP%27 HTTP/1.1" 200 None
2026-03-28 11:10:09 [bca.uk] INFO: Scrape type for MK74%20HBP: 2
2026-03-28 11:10:09 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 45f96705-4de4-5366-aa5e-7e0dbd5bca26 with identifier: MK74%20HBP
2026-03-28 11:10:09 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 45f96705-4de4-5366-aa5e-7e0dbd5bca26 with scrape type 2
2026-03-28 11:10:09 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 45f96705-4de4-5366-aa5e-7e0dbd5bca26 with scrape type 2
2026-03-28 11:10:09 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 45f96705-4de4-5366-aa5e-7e0dbd5bca26, identifier: MK74%20HBP
2026-03-28 11:10:09 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 45f96705-4de4-5366-aa5e-7e0dbd5bca26 with identifier: MK74%20HBP
2026-03-28 11:10:09 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 45f96705-4de4-5366-aa5e-7e0dbd5bca26 with identifier: MK74%20HBP
2026-03-28 11:10:09 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 45f96705-4de4-5366-aa5e-7e0dbd5bca26 with identifier: MK74%20HBP to the API
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:09 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK74%20HBP-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '45f96705-4de4-5366-aa5e-7e0dbd5bca26',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MK74 HBP',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK74%20HBP&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '208',
'odometer': 5997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 100 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 100 ALLURE',
'vin': 'VR3UPHNE3R4306064',
'year': 2024}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK74%2520HBP%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [bca.uk] INFO: Saving data for MK74%20HBP: {'auction_closing_time': 1775124000.0, 'created_time': 1773821487.703582, 'last_price_update_time': 1774696210.041272}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK74%2520HBP') HTTP/1.1" 204 0
2026-03-28 11:10:10 [bca.uk] INFO: Found listing with ID: VU24%20HZM
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU24%2520HZM%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [bca.uk] INFO: Scrape type for VU24%20HZM: 2
2026-03-28 11:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1a5dfce0-43ed-5650-80a2-abceb15c2b5f with identifier: VU24%20HZM
2026-03-28 11:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1a5dfce0-43ed-5650-80a2-abceb15c2b5f with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1a5dfce0-43ed-5650-80a2-abceb15c2b5f with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1a5dfce0-43ed-5650-80a2-abceb15c2b5f, identifier: VU24%20HZM
2026-03-28 11:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1a5dfce0-43ed-5650-80a2-abceb15c2b5f with identifier: VU24%20HZM
2026-03-28 11:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1a5dfce0-43ed-5650-80a2-abceb15c2b5f with identifier: VU24%20HZM
2026-03-28 11:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1a5dfce0-43ed-5650-80a2-abceb15c2b5f with identifier: VU24%20HZM to the API
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU24%20HZM-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1a5dfce0-43ed-5650-80a2-abceb15c2b5f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VU24 HZM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VU24%20HZM&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 21998,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNS8RY524718',
'year': 2024}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU24%2520HZM%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [bca.uk] INFO: Saving data for VU24%20HZM: {'auction_closing_time': 1775124000.0, 'created_time': 1774004547.22977, 'last_price_update_time': 1774696210.480414}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VU24%2520HZM') HTTP/1.1" 204 0
2026-03-28 11:10:10 [bca.uk] INFO: Found listing with ID: BN25%20RFX
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN25%2520RFX%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [bca.uk] INFO: Scrape type for BN25%20RFX: 2
2026-03-28 11:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1d57fb1c-c3cb-501c-a318-acef6541495b with identifier: BN25%20RFX
2026-03-28 11:10:10 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1d57fb1c-c3cb-501c-a318-acef6541495b with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1d57fb1c-c3cb-501c-a318-acef6541495b with scrape type 2
2026-03-28 11:10:10 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1d57fb1c-c3cb-501c-a318-acef6541495b, identifier: BN25%20RFX
2026-03-28 11:10:10 [scrapy.extensions.logstats] INFO: Crawled 205 pages (at 7 pages/min), scraped 447 items (at 19 items/min)
2026-03-28 11:10:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:10:10 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1d57fb1c-c3cb-501c-a318-acef6541495b with identifier: BN25%20RFX
2026-03-28 11:10:10 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1d57fb1c-c3cb-501c-a318-acef6541495b with identifier: BN25%20RFX
2026-03-28 11:10:10 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1d57fb1c-c3cb-501c-a318-acef6541495b with identifier: BN25%20RFX to the API
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:10 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 130,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN25%20RFX-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '1d57fb1c-c3cb-501c-a318-acef6541495b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'BN25 RFX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN25%20RFX&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': '5008',
'odometer': 27010,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2025-01-01',
'seller_name': None,
'title': 'PEUGEOT 5008 1.2 MHEV 136 ALLURE E-DSC6 StationWagon',
'transmission': 'automatic',
'trim': 'MHEV 136 ALLURE E-DSC6',
'vin': 'VR3KAHPY1SS020604',
'year': 2025}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN25%2520RFX%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [bca.uk] INFO: Saving data for BN25%20RFX: {'auction_closing_time': 1775124000.0, 'created_time': 1773842947.329803, 'last_price_update_time': 1774696210.958029}
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN25%2520RFX') HTTP/1.1" 204 0
2026-03-28 11:10:10 [bca.uk] INFO: Found listing with ID: MA24%20JNK
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520JNK%27 HTTP/1.1" 200 None
2026-03-28 11:10:10 [bca.uk] INFO: Scrape type for MA24%20JNK: 2
2026-03-28 11:10:10 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 3ad78c57-2ba2-5bc6-802e-7c207f35f729 with identifier: MA24%20JNK
2026-03-28 11:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 3ad78c57-2ba2-5bc6-802e-7c207f35f729 with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 3ad78c57-2ba2-5bc6-802e-7c207f35f729 with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 3ad78c57-2ba2-5bc6-802e-7c207f35f729, identifier: MA24%20JNK
2026-03-28 11:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 3ad78c57-2ba2-5bc6-802e-7c207f35f729 with identifier: MA24%20JNK
2026-03-28 11:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 3ad78c57-2ba2-5bc6-802e-7c207f35f729 with identifier: MA24%20JNK
2026-03-28 11:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 3ad78c57-2ba2-5bc6-802e-7c207f35f729 with identifier: MA24%20JNK to the API
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:11 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA24%20JNK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Electric',
'id': '3ad78c57-2ba2-5bc6-802e-7c207f35f729',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MA24 JNK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA24%20JNK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': 'E-208',
'odometer': 17152,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT E-208 100KW 50KWH E-STYLE Hatchback',
'transmission': 'automatic',
'trim': '100KW 50KWH E-STYLE',
'vin': 'VR3UHZKX8P4373605',
'year': 2024}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520JNK%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [bca.uk] INFO: Saving data for MA24%20JNK: {'auction_closing_time': 1775124000.0, 'created_time': 1774004541.805961, 'last_price_update_time': 1774696211.57519}
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA24%2520JNK') HTTP/1.1" 204 0
2026-03-28 11:10:11 [bca.uk] INFO: Found listing with ID: MA74%20XZG
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA74%2520XZG%27 HTTP/1.1" 200 None
2026-03-28 11:10:11 [bca.uk] INFO: Scrape type for MA74%20XZG: 2
2026-03-28 11:10:11 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 25931547-0c9a-5d6f-89fe-2a1cea86d335 with identifier: MA74%20XZG
2026-03-28 11:10:11 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 25931547-0c9a-5d6f-89fe-2a1cea86d335 with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 25931547-0c9a-5d6f-89fe-2a1cea86d335 with scrape type 2
2026-03-28 11:10:11 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 25931547-0c9a-5d6f-89fe-2a1cea86d335, identifier: MA74%20XZG
2026-03-28 11:10:11 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 25931547-0c9a-5d6f-89fe-2a1cea86d335 with identifier: MA74%20XZG
2026-03-28 11:10:11 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 25931547-0c9a-5d6f-89fe-2a1cea86d335 with identifier: MA74%20XZG
2026-03-28 11:10:11 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 25931547-0c9a-5d6f-89fe-2a1cea86d335 with identifier: MA74%20XZG to the API
2026-03-28 11:10:11 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MA74%20XZG-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Electric',
'id': '25931547-0c9a-5d6f-89fe-2a1cea86d335',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MA74 XZG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MA74%20XZG&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'PEUGEOT',
'model': 'E-308',
'odometer': 5168,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT E-308 115KW 54KWH GT Hatchback',
'transmission': 'automatic',
'trim': '115KW 54KWH GT',
'vin': 'VR3FMZKW3RY525104',
'year': 2024}
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA74%2520XZG%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Saving data for MA74%20XZG: {'auction_closing_time': 1775124000.0, 'created_time': 1774265590.394024, 'last_price_update_time': 1774696212.201886}
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MA74%2520XZG') HTTP/1.1" 204 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: DC66%20YYE
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC66%2520YYE%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for DC66%20YYE: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: KW70%20UST
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW70%2520UST%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for KW70%20UST: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: KN17%20YTF
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN17%2520YTF%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for KN17%20YTF: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: CK63%20KKN
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK63%2520KKN%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for CK63%20KKN: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: BK24%20HFU
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK24%2520HFU%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for BK24%20HFU: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: KF73%20DDU
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520DDU%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for KF73%20DDU: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: MH73%20VJA
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH73%2520VJA%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for MH73%20VJA: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: MJ73%20PXM
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ73%2520PXM%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for MJ73%20PXM: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: BD72%20HUJ
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD72%2520HUJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for BD72%20HUJ: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: PK72%20OLE
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK72%2520OLE%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for PK72%20OLE: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: DV74%20ORK
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV74%2520ORK%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for DV74%20ORK: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: SB61%20FZU
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB61%2520FZU%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for SB61%20FZU: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: BP72%20UKO
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520UKO%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for BP72%20UKO: 0
2026-03-28 11:10:12 [bca.uk] INFO: Found listing with ID: CV73%20TVT
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV73%2520TVT%27 HTTP/1.1" 200 None
2026-03-28 11:10:12 [bca.uk] INFO: Scrape type for CV73%20TVT: 2
2026-03-28 11:10:12 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 83f02412-7ef0-5800-961d-43e56966fd8a with identifier: CV73%20TVT
2026-03-28 11:10:12 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 83f02412-7ef0-5800-961d-43e56966fd8a with scrape type 2
2026-03-28 11:10:12 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 83f02412-7ef0-5800-961d-43e56966fd8a with scrape type 2
2026-03-28 11:10:12 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 83f02412-7ef0-5800-961d-43e56966fd8a, identifier: CV73%20TVT
2026-03-28 11:10:12 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 83f02412-7ef0-5800-961d-43e56966fd8a with identifier: CV73%20TVT
2026-03-28 11:10:12 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 83f02412-7ef0-5800-961d-43e56966fd8a with identifier: CV73%20TVT
2026-03-28 11:10:12 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 83f02412-7ef0-5800-961d-43e56966fd8a with identifier: CV73%20TVT to the API
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:12 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 40,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CV73%20TVT-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '83f02412-7ef0-5800-961d-43e56966fd8a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'CV73 TVT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CV73%20TVT&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'PEUGEOT',
'model': '508 FASTBACK',
'odometer': 9034,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'PEUGEOT 508 FASTBACK 1.6 PHEV-4 PSE E-EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'PHEV-4 PSE E-EAT8',
'vin': 'VR3F35GBTPY588362',
'year': 2023}
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:12 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV73%2520TVT%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Saving data for CV73%20TVT: {'auction_closing_time': 1775037600.0, 'created_time': 1773835018.583201, 'last_price_update_time': 1774696213.000473}
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CV73%2520TVT') HTTP/1.1" 204 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: GY24%20FOF
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520FOF%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for GY24%20FOF: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: LO73%20OTD
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO73%2520OTD%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for LO73%20OTD: 2
2026-03-28 11:10:13 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0e5b8768-c5d6-5a63-a48a-f87fe118407e with identifier: LO73%20OTD
2026-03-28 11:10:13 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0e5b8768-c5d6-5a63-a48a-f87fe118407e with scrape type 2
2026-03-28 11:10:13 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0e5b8768-c5d6-5a63-a48a-f87fe118407e with scrape type 2
2026-03-28 11:10:13 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0e5b8768-c5d6-5a63-a48a-f87fe118407e, identifier: LO73%20OTD
2026-03-28 11:10:13 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0e5b8768-c5d6-5a63-a48a-f87fe118407e with identifier: LO73%20OTD
2026-03-28 11:10:13 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0e5b8768-c5d6-5a63-a48a-f87fe118407e with identifier: LO73%20OTD
2026-03-28 11:10:13 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0e5b8768-c5d6-5a63-a48a-f87fe118407e with identifier: LO73%20OTD to the API
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:13 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 133,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LO73%20OTD-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '0e5b8768-c5d6-5a63-a48a-f87fe118407e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LO73 OTD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LO73%20OTD&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'PEUGEOT',
'model': '2008',
'odometer': 9894,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'PEUGEOT 2008 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3USHNSSPJ866222',
'year': 2023}
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO73%2520OTD%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Saving data for LO73%20OTD: {'auction_closing_time': 1775124000.0, 'created_time': 1773841944.963033, 'last_price_update_time': 1774696213.669257}
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LO73%2520OTD') HTTP/1.1" 204 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: BK25%20JPY
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK25%2520JPY%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for BK25%20JPY: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: BN25%20YFP
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN25%2520YFP%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for BN25%20YFP: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: ML24%20ZWD
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML24%2520ZWD%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for ML24%20ZWD: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: MP73%20JGY
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP73%2520JGY%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for MP73%20JGY: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: FE23%20WVO
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE23%2520WVO%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for FE23%20WVO: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: DL74%20WCW
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL74%2520WCW%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for DL74%20WCW: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: DL24%20KTE
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL24%2520KTE%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for DL24%20KTE: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: RF69%20NDU
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF69%2520NDU%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for RF69%20NDU: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: GD18%20PWN
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD18%2520PWN%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for GD18%20PWN: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: LC54%20OBX
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC54%2520OBX%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for LC54%20OBX: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: PF67%20TMY
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:13 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF67%2520TMY%27 HTTP/1.1" 200 None
2026-03-28 11:10:13 [bca.uk] INFO: Scrape type for PF67%20TMY: 0
2026-03-28 11:10:13 [bca.uk] INFO: Found listing with ID: KP09%20NHV
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP09%2520NHV%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for KP09%20NHV: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: HD19%20BVL
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD19%2520BVL%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for HD19%20BVL: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: YR68%20LNT
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR68%2520LNT%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for YR68%20LNT: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: AO58%20XLV
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO58%2520XLV%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for AO58%20XLV: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: AY67%20XMG
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY67%2520XMG%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for AY67%20XMG: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: FP65%20XHH
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP65%2520XHH%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for FP65%20XHH: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: HF15%20WKE
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF15%2520WKE%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for HF15%20WKE: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: KS14%20BAA
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS14%2520BAA%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for KS14%20BAA: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WK14%20MMJ
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK14%2520MMJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WK14%20MMJ: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WR63%20FVN
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR63%2520FVN%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WR63%20FVN: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WW66%20ATW
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WW66%2520ATW%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WW66%20ATW: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: YC14%20HNO
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC14%2520HNO%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for YC14%20HNO: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: YT14%20AXC
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT14%2520AXC%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for YT14%20AXC: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: PE71%20WFO
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE71%2520WFO%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for PE71%20WFO: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: CV16%20UMD
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV16%2520UMD%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for CV16%20UMD: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: LC72%20OCH
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC72%2520OCH%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for LC72%20OCH: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WG63%20CKL
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG63%2520CKL%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WG63%20CKL: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: CJZ%205249
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJZ%25205249%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for CJZ%205249: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: BX69%20LMO
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX69%2520LMO%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for BX69%20LMO: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: BK73%20UUW
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK73%2520UUW%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for BK73%20UUW: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: HV74%20EPJ
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV74%2520EPJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for HV74%20EPJ: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WP24%20EAF
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP24%2520EAF%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WP24%20EAF: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WT25%20FYY
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT25%2520FYY%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WT25%20FYY: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: WV25%20PZF
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV25%2520PZF%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for WV25%20PZF: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: FG72%20LTY
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG72%2520LTY%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for FG72%20LTY: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: HY75%20LNV
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY75%2520LNV%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for HY75%20LNV: 0
2026-03-28 11:10:14 [bca.uk] INFO: Found listing with ID: MK24%20ZJJ
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK24%2520ZJJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:14 [bca.uk] INFO: Scrape type for MK24%20ZJJ: 2
2026-03-28 11:10:14 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 21bc7b7f-3e50-5873-bb61-0aaea288b5cb with identifier: MK24%20ZJJ
2026-03-28 11:10:14 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 21bc7b7f-3e50-5873-bb61-0aaea288b5cb with scrape type 2
2026-03-28 11:10:14 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 21bc7b7f-3e50-5873-bb61-0aaea288b5cb with scrape type 2
2026-03-28 11:10:14 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 21bc7b7f-3e50-5873-bb61-0aaea288b5cb, identifier: MK24%20ZJJ
2026-03-28 11:10:14 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 21bc7b7f-3e50-5873-bb61-0aaea288b5cb with identifier: MK24%20ZJJ
2026-03-28 11:10:14 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 21bc7b7f-3e50-5873-bb61-0aaea288b5cb with identifier: MK24%20ZJJ
2026-03-28 11:10:14 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 21bc7b7f-3e50-5873-bb61-0aaea288b5cb with identifier: MK24%20ZJJ to the API
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:14 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 145,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MK24%20ZJJ-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '21bc7b7f-3e50-5873-bb61-0aaea288b5cb',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'MK24 ZJJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MK24%20ZJJ&vehicleType=*',
'listing': 'auction',
'location': 'Bridgwater',
'make': 'PEUGEOT',
'model': '3008',
'odometer': 12975,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 3008 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VF3MRHNSURS021322',
'year': 2024}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK24%2520ZJJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [bca.uk] INFO: Saving data for MK24%20ZJJ: {'auction_closing_time': 1775124000.0, 'created_time': 1773933172.678275, 'last_price_update_time': 1774696215.118238}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MK24%2520ZJJ') HTTP/1.1" 204 0
2026-03-28 11:10:15 [bca.uk] INFO: Found listing with ID: WF24%20RVO
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF24%2520RVO%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [bca.uk] INFO: Scrape type for WF24%20RVO: 0
2026-03-28 11:10:15 [bca.uk] INFO: Found listing with ID: LS24%20WGD
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520WGD%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [bca.uk] INFO: Scrape type for LS24%20WGD: 2
2026-03-28 11:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 36f67ac1-6ad4-52f9-8af0-ca8def5108d0 with identifier: LS24%20WGD
2026-03-28 11:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 36f67ac1-6ad4-52f9-8af0-ca8def5108d0 with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 36f67ac1-6ad4-52f9-8af0-ca8def5108d0 with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 36f67ac1-6ad4-52f9-8af0-ca8def5108d0, identifier: LS24%20WGD
2026-03-28 11:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 36f67ac1-6ad4-52f9-8af0-ca8def5108d0 with identifier: LS24%20WGD
2026-03-28 11:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 36f67ac1-6ad4-52f9-8af0-ca8def5108d0 with identifier: LS24%20WGD
2026-03-28 11:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 36f67ac1-6ad4-52f9-8af0-ca8def5108d0 with identifier: LS24%20WGD to the API
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:15 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS24%20WGD-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '36f67ac1-6ad4-52f9-8af0-ca8def5108d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'LS24 WGD',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LS24%20WGD&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 10789,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 ALLURE EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 ALLURE EAT8',
'vin': 'VR3FPHNS5RY521713',
'year': 2024}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS24%2520WGD%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [bca.uk] INFO: Saving data for LS24%20WGD: {'auction_closing_time': 1775124000.0, 'created_time': 1773933709.008659, 'last_price_update_time': 1774696215.715809}
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LS24%2520WGD') HTTP/1.1" 204 0
2026-03-28 11:10:15 [bca.uk] INFO: Found listing with ID: VO24%20UZR
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520UZR%27 HTTP/1.1" 200 None
2026-03-28 11:10:15 [bca.uk] INFO: Scrape type for VO24%20UZR: 2
2026-03-28 11:10:15 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9c494883-3607-5ba3-861b-5281b78f84a2 with identifier: VO24%20UZR
2026-03-28 11:10:15 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9c494883-3607-5ba3-861b-5281b78f84a2 with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9c494883-3607-5ba3-861b-5281b78f84a2 with scrape type 2
2026-03-28 11:10:15 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9c494883-3607-5ba3-861b-5281b78f84a2, identifier: VO24%20UZR
2026-03-28 11:10:15 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9c494883-3607-5ba3-861b-5281b78f84a2 with identifier: VO24%20UZR
2026-03-28 11:10:15 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9c494883-3607-5ba3-861b-5281b78f84a2 with identifier: VO24%20UZR
2026-03-28 11:10:15 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9c494883-3607-5ba3-861b-5281b78f84a2 with identifier: VO24%20UZR to the API
2026-03-28 11:10:15 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VO24%20UZR-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9c494883-3607-5ba3-861b-5281b78f84a2',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'VO24 UZR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VO24%20UZR&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 23515,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNS3RY523699',
'year': 2024}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO24%2520UZR%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [bca.uk] INFO: Saving data for VO24%20UZR: {'auction_closing_time': 1775124000.0, 'created_time': 1773933720.155593, 'last_price_update_time': 1774696216.174677}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VO24%2520UZR') HTTP/1.1" 204 0
2026-03-28 11:10:16 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=19&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:10:16 [bca.uk] INFO: Found listing with ID: NL12%20XCO
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520XCO%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [bca.uk] INFO: Scrape type for NL12%20XCO: 0
2026-03-28 11:10:16 [bca.uk] INFO: Found listing with ID: CF74%20HXJ
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520HXJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [bca.uk] INFO: Scrape type for CF74%20HXJ: 2
2026-03-28 11:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2ee6f822-5487-5245-a9d9-fd18f2e91f0e with identifier: CF74%20HXJ
2026-03-28 11:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2ee6f822-5487-5245-a9d9-fd18f2e91f0e with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2ee6f822-5487-5245-a9d9-fd18f2e91f0e with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2ee6f822-5487-5245-a9d9-fd18f2e91f0e, identifier: CF74%20HXJ
2026-03-28 11:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2ee6f822-5487-5245-a9d9-fd18f2e91f0e with identifier: CF74%20HXJ
2026-03-28 11:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2ee6f822-5487-5245-a9d9-fd18f2e91f0e with identifier: CF74%20HXJ
2026-03-28 11:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2ee6f822-5487-5245-a9d9-fd18f2e91f0e with identifier: CF74%20HXJ to the API
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:16 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CF74%20HXJ-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-02T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2ee6f822-5487-5245-a9d9-fd18f2e91f0e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'CF74 HXJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CF74%20HXJ&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '208',
'odometer': 19368,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 208 1.2 P/T 100 ALLURE Hatchback',
'transmission': 'manual',
'trim': 'P/T 100 ALLURE',
'vin': 'VR3UPHNE2R4299169',
'year': 2024}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF74%2520HXJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [bca.uk] INFO: Saving data for CF74%20HXJ: {'auction_closing_time': 1775124000.0, 'created_time': 1773841913.709633, 'last_price_update_time': 1774696216.649638}
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CF74%2520HXJ') HTTP/1.1" 204 0
2026-03-28 11:10:16 [bca.uk] INFO: Found listing with ID: ML24%20FWG
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML24%2520FWG%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [bca.uk] INFO: Scrape type for ML24%20FWG: 0
2026-03-28 11:10:16 [bca.uk] INFO: Found listing with ID: BN74%20PFA
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN74%2520PFA%27 HTTP/1.1" 200 None
2026-03-28 11:10:16 [bca.uk] INFO: Scrape type for BN74%20PFA: 2
2026-03-28 11:10:16 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5106963a-9d0c-54d1-b969-9da1b3fa53d8 with identifier: BN74%20PFA
2026-03-28 11:10:16 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5106963a-9d0c-54d1-b969-9da1b3fa53d8 with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5106963a-9d0c-54d1-b969-9da1b3fa53d8 with scrape type 2
2026-03-28 11:10:16 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5106963a-9d0c-54d1-b969-9da1b3fa53d8, identifier: BN74%20PFA
2026-03-28 11:10:16 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5106963a-9d0c-54d1-b969-9da1b3fa53d8 with identifier: BN74%20PFA
2026-03-28 11:10:16 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5106963a-9d0c-54d1-b969-9da1b3fa53d8 with identifier: BN74%20PFA
2026-03-28 11:10:16 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 5106963a-9d0c-54d1-b969-9da1b3fa53d8 with identifier: BN74%20PFA to the API
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:16 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN74%20PFA-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5106963a-9d0c-54d1-b969-9da1b3fa53d8',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'BN74 PFA',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN74%20PFA&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 27591,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNS2RY564048',
'year': 2024}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN74%2520PFA%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Saving data for BN74%20PFA: {'auction_closing_time': 1775037600.0, 'created_time': 1773909404.555264, 'last_price_update_time': 1774696217.101142}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN74%2520PFA') HTTP/1.1" 204 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: BN74%20PFG
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN74%2520PFG%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for BN74%20PFG: 2
2026-03-28 11:10:17 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 2f439090-4db9-5223-9a7c-b9a7af4b9506 with identifier: BN74%20PFG
2026-03-28 11:10:17 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 2f439090-4db9-5223-9a7c-b9a7af4b9506 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 2f439090-4db9-5223-9a7c-b9a7af4b9506 with scrape type 2
2026-03-28 11:10:17 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 2f439090-4db9-5223-9a7c-b9a7af4b9506, identifier: BN74%20PFG
2026-03-28 11:10:17 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 2f439090-4db9-5223-9a7c-b9a7af4b9506 with identifier: BN74%20PFG
2026-03-28 11:10:17 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 2f439090-4db9-5223-9a7c-b9a7af4b9506 with identifier: BN74%20PFG
2026-03-28 11:10:17 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 2f439090-4db9-5223-9a7c-b9a7af4b9506 with identifier: BN74%20PFG to the API
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:17 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=18&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 136,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BN74%20PFG-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-04-01T10:00:00Z',
'fuel_type': 'Petrol',
'id': '2f439090-4db9-5223-9a7c-b9a7af4b9506',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'BN74 PFG',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BN74%20PFG&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'PEUGEOT',
'model': '408 FASTBACK',
'odometer': 15286,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2024-01-01',
'seller_name': None,
'title': 'PEUGEOT 408 FASTBACK 1.2 P/T 130 GT EAT8 Hatchback',
'transmission': 'automatic',
'trim': 'P/T 130 GT EAT8',
'vin': 'VR3FPHNS3RY564110',
'year': 2024}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN74%2520PFG%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Saving data for BN74%20PFG: {'auction_closing_time': 1775037600.0, 'created_time': 1773826280.579236, 'last_price_update_time': 1774696217.579772}
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BN74%2520PFG') HTTP/1.1" 204 0
2026-03-28 11:10:17 [bca.uk] INFO: Total items found: 100
2026-03-28 11:10:17 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded
2026-03-28 11:10:17 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:10:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: CK20%20HYT
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK20%2520HYT%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for CK20%20HYT: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: CU67%20XXH
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU67%2520XXH%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for CU67%20XXH: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: NA68%20XGU
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520XGU%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for NA68%20XGU: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: NU21%20OGO
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU21%2520OGO%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for NU21%20OGO: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: WF21%20HLG
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF21%2520HLG%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for WF21%20HLG: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: WP18%20YCL
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP18%2520YCL%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for WP18%20YCL: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: BD16%20KZP
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD16%2520KZP%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for BD16%20KZP: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: CF24%20PVA
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CF24%2520PVA%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for CF24%20PVA: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: YC18%20RMV
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC18%2520RMV%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for YC18%20RMV: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: BN12%20KXP
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN12%2520KXP%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for BN12%20KXP: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: BT61%20XNA
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT61%2520XNA%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for BT61%20XNA: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: CK08%20CVS
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK08%2520CVS%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for CK08%20CVS: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: DS16%20VMX
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS16%2520VMX%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for DS16%20VMX: 0
2026-03-28 11:10:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:17 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: FV64%20PXZ
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520PXZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for FV64%20PXZ: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: KV64%20UGE
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV64%2520UGE%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for KV64%20UGE: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: YF57%20YKB
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF57%2520YKB%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for YF57%20YKB: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: YN63%20HJU
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN63%2520HJU%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for YN63%20HJU: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: YR61%20KFN
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR61%2520KFN%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for YR61%20KFN: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: LS13%20MVJ
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS13%2520MVJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for LS13%20MVJ: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: MD11%20XHJ
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD11%2520XHJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for MD11%20XHJ: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: SJ63%20URU
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ63%2520URU%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for SJ63%20URU: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: SY13%20WKR
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY13%2520WKR%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for SY13%20WKR: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: VA64%20FFD
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:17 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA64%2520FFD%27 HTTP/1.1" 200 None
2026-03-28 11:10:17 [bca.uk] INFO: Scrape type for VA64%20FFD: 0
2026-03-28 11:10:17 [bca.uk] INFO: Found listing with ID: YC10%20VCE
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC10%2520VCE%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for YC10%20VCE: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: YD62%20CXW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD62%2520CXW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for YD62%20CXW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: YH07%20EZO
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH07%2520EZO%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for YH07%20EZO: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: YH11%20VVD
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH11%2520VVD%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for YH11%20VVD: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: YH63%20TXR
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH63%2520TXR%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for YH63%20TXR: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BG17%20FBZ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG17%2520FBZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for BG17%20FBZ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BK14%20BWW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK14%2520BWW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for BK14%20BWW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BV62%20XPX
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV62%2520XPX%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for BV62%20XPX: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: CV15%20YWG
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV15%2520YWG%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for CV15%20YWG: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DU64%20MTJ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520MTJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DU64%20MTJ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: EU13%20RYM
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU13%2520RYM%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for EU13%20RYM: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: FN62%20KSE
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN62%2520KSE%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for FN62%20KSE: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: HY13%20KZZ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY13%2520KZZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for HY13%20KZZ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LE14%20MAZ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE14%2520MAZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LE14%20MAZ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LO59%20WEW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO59%2520WEW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LO59%20WEW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: GU68%20BPY
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU68%2520BPY%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for GU68%20BPY: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20TKJ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TKJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20TKJ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: NU68%20ZKE
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU68%2520ZKE%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for NU68%20ZKE: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LO17%20DVV
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO17%2520DVV%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LO17%20DVV: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20TFA
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TFA%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20TFA: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: VO65%20FFY
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO65%2520FFY%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for VO65%20FFY: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LO16%20XHU
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO16%2520XHU%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LO16%20XHU: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: YR58%20LGK
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR58%2520LGK%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for YR58%20LGK: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BF09%20YCP
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF09%2520YCP%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for BF09%20YCP: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BW15%20CWC
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BW15%2520CWC%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for BW15%20CWC: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: CK13%20HGY
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK13%2520HGY%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for CK13%20HGY: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DU16%20DZP
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU16%2520DZP%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DU16%20DZP: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LC63%20KKO
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC63%2520KKO%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LC63%20KKO: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: PK62%20FRL
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK62%2520FRL%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for PK62%20FRL: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: SJ14%20OEO
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ14%2520OEO%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for SJ14%20OEO: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: VU63%20VOH
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU63%2520VOH%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for VU63%20VOH: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20UDX
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520UDX%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20UDX: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BG18%20KHJ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG18%2520KHJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for BG18%20KHJ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: VO23%20XPB
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO23%2520XPB%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for VO23%20XPB: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LN12%20FCM
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN12%2520FCM%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LN12%20FCM: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: MM64%20HTZ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM64%2520HTZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for MM64%20HTZ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: WP65%20BKF
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP65%2520BKF%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for WP65%20BKF: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: AE16%20PZA
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE16%2520PZA%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for AE16%20PZA: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: EG17%20GCX
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EG17%2520GCX%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for EG17%20GCX: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: KY15%20XBT
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY15%2520XBT%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for KY15%20XBT: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: KY16%20YLL
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY16%2520YLL%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for KY16%20YLL: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20TDO
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TDO%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20TDO: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20TTV
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TTV%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20TTV: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DS13%20FUY
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS13%2520FUY%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DS13%20FUY: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: EU63%20XYW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU63%2520XYW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for EU63%20XYW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: ND63%20BDY
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND63%2520BDY%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for ND63%20BDY: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: PO63%20YJM
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PO63%2520YJM%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for PO63%20YJM: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20TBV
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TBV%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20TBV: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DP23%20TLK
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP23%2520TLK%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DP23%20TLK: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LX63%20NNP
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX63%2520NNP%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LX63%20NNP: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: MT55%20RZS
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT55%2520RZS%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for MT55%20RZS: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: PX63%20KGU
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX63%2520KGU%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for PX63%20KGU: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: KV11%20VXT
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV11%2520VXT%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for KV11%20VXT: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: AF16%20MHA
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF16%2520MHA%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for AF16%20MHA: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: DS65%20GCV
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520GCV%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for DS65%20GCV: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: EK11%20EKW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK11%2520EKW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for EK11%20EKW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: LV13%20AFO
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520AFO%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for LV13%20AFO: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: MT66%20ALO
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT66%2520ALO%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for MT66%20ALO: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: NU70%20NRJ
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU70%2520NRJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for NU70%20NRJ: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: EK60%20DYW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK60%2520DYW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for EK60%20DYW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: HG60%20EWW
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG60%2520EWW%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for HG60%20EWW: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: SM58%20BYK
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM58%2520BYK%27 HTTP/1.1" 200 None
2026-03-28 11:10:18 [bca.uk] INFO: Scrape type for SM58%20BYK: 0
2026-03-28 11:10:18 [bca.uk] INFO: Found listing with ID: BT16%20ZKM
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT16%2520ZKM%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for BT16%20ZKM: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: NA14%20KDN
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA14%2520KDN%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for NA14%20KDN: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: LXZ%202306
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LXZ%25202306%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for LXZ%202306: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: SB59%20ZXF
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB59%2520ZXF%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for SB59%20ZXF: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: SN63%20BDZ
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520BDZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for SN63%20BDZ: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: MW61%20RRY
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW61%2520RRY%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for MW61%20RRY: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: FG63%20KGP
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG63%2520KGP%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for FG63%20KGP: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: FT63%20LWA
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT63%2520LWA%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for FT63%20LWA: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: LD63%20SKU
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD63%2520SKU%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for LD63%20SKU: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: SA17%20FAF
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA17%2520FAF%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for SA17%20FAF: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: ST18%20ZDH
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST18%2520ZDH%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for ST18%20ZDH: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: SL17%20NGU
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL17%2520NGU%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for SL17%20NGU: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: KE10%20GKG
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE10%2520GKG%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for KE10%20GKG: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: NJ65%20EOT
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ65%2520EOT%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for NJ65%20EOT: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: SF65%20JXH
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF65%2520JXH%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for SF65%20JXH: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: AO63%20XYY
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO63%2520XYY%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for AO63%20XYY: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: SV09%20YGZ
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV09%2520YGZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for SV09%20YGZ: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: HX14%20DND
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX14%2520DND%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for HX14%20DND: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: BL12%20XGC
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL12%2520XGC%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for BL12%20XGC: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: CE68%20ACJ
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE68%2520ACJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for CE68%20ACJ: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: GV16%20GUF
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV16%2520GUF%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for GV16%20GUF: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: YH59%20CCY
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH59%2520CCY%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for YH59%20CCY: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: KP12%20CGG
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP12%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for KP12%20CGG: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: LG13%20VGK
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG13%2520VGK%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for LG13%20VGK: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: MJ10%20PDX
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ10%2520PDX%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for MJ10%20PDX: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: RE16%20YZZ
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE16%2520YZZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for RE16%20YZZ: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: GX08%20LUH
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX08%2520LUH%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for GX08%20LUH: 0
2026-03-28 11:10:19 [bca.uk] INFO: Found listing with ID: LC59%20TXU
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC59%2520TXU%27 HTTP/1.1" 200 None
2026-03-28 11:10:19 [bca.uk] INFO: Scrape type for LC59%20TXU: 0
2026-03-28 11:10:19 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:29 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:10:29 [bca.uk] INFO: Total items found: 100
2026-03-28 11:10:29 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded
2026-03-28 11:10:29 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:10:29 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: LR57%20XYT
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR57%2520XYT%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for LR57%20XYT: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: BK14%20WCG
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK14%2520WCG%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for BK14%20WCG: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: SN13%20JLU
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN13%2520JLU%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for SN13%20JLU: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: FH68%20GOC
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH68%2520GOC%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for FH68%20GOC: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: MJ18%20TFA
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ18%2520TFA%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for MJ18%20TFA: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: AE69%20JHY
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE69%2520JHY%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for AE69%20JHY: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: AJ71%20VEF
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ71%2520VEF%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for AJ71%20VEF: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: BN22%20KRF
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN22%2520KRF%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for BN22%20KRF: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: CU22%20ZXR
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU22%2520ZXR%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for CU22%20ZXR: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: FD71%20JXN
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD71%2520JXN%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for FD71%20JXN: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: FH73%20MKE
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH73%2520MKE%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for FH73%20MKE: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: KE72%20LSK
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE72%2520LSK%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for KE72%20LSK: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: N28%20CVL
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N28%2520CVL%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for N28%20CVL: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: NV19%20EUZ
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520EUZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for NV19%20EUZ: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: OV19%20VEK
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV19%2520VEK%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for OV19%20VEK: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: OV23%20GWX
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520GWX%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for OV23%20GWX: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: OY20%20RGO
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY20%2520RGO%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for OY20%20RGO: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: RJ70%20WKD
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ70%2520WKD%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for RJ70%20WKD: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: SJ21%20YDN
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ21%2520YDN%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for SJ21%20YDN: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: WR65%20VAA
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR65%2520VAA%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for WR65%20VAA: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: BF65%20UEM
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF65%2520UEM%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for BF65%20UEM: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: BK66%20UHO
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK66%2520UHO%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for BK66%20UHO: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: BN16%20NVM
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520NVM%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for BN16%20NVM: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: DF15%20DVU
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF15%2520DVU%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for DF15%20DVU: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: DS65%20TDO
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DS65%2520TDO%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for DS65%20TDO: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: EK15%20BVP
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK15%2520BVP%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for EK15%20BVP: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: HJ67%20ZKN
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ67%2520ZKN%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for HJ67%20ZKN: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: LV14%20OLB
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:29 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV14%2520OLB%27 HTTP/1.1" 200 None
2026-03-28 11:10:29 [bca.uk] INFO: Scrape type for LV14%20OLB: 0
2026-03-28 11:10:29 [bca.uk] INFO: Found listing with ID: SY64%20TWV
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY64%2520TWV%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for SY64%20TWV: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: WN16%20YNB
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN16%2520YNB%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for WN16%20YNB: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: AF16%20VPJ
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF16%2520VPJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for AF16%20VPJ: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: AU16%20ZSX
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU16%2520ZSX%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for AU16%20ZSX: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: AF22%20UDK
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF22%2520UDK%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for AF22%20UDK: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: AW21%20DVU
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AW21%2520DVU%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for AW21%20DVU: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: AY22%20JSZ
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY22%2520JSZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for AY22%20JSZ: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: BJ73%20XAY
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ73%2520XAY%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for BJ73%20XAY: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: BP72%20FTD
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520FTD%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for BP72%20FTD: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: BP72%20ZZO
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520ZZO%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for BP72%20ZZO: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: CV23%20KXX
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV23%2520KXX%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for CV23%20KXX: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: DE23%20JPO
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE23%2520JPO%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for DE23%20JPO: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: DG24%20FYS
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG24%2520FYS%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for DG24%20FYS: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: FJ21%20VJM
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ21%2520VJM%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for FJ21%20VJM: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: FJ71%20TZW
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ71%2520TZW%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for FJ71%20TZW: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: FN22%20LFB
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN22%2520LFB%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for FN22%20LFB: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: GJ22%20RXN
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ22%2520RXN%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for GJ22%20RXN: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: GN73%20XFP
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN73%2520XFP%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for GN73%20XFP: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: GP21%20FTU
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP21%2520FTU%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for GP21%20FTU: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: GU23%20XLN
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU23%2520XLN%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for GU23%20XLN: 0
2026-03-28 11:10:30 [bca.uk] INFO: Found listing with ID: GV71%20PYT
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV71%2520PYT%27 HTTP/1.1" 200 None
2026-03-28 11:10:30 [bca.uk] INFO: Scrape type for GV71%20PYT: 2
2026-03-28 11:10:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 31de69ed-cb0c-5a26-8df8-038956215375 with identifier: GV71%20PYT
2026-03-28 11:10:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 31de69ed-cb0c-5a26-8df8-038956215375 with scrape type 2
2026-03-28 11:10:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 31de69ed-cb0c-5a26-8df8-038956215375 with scrape type 2
2026-03-28 11:10:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 31de69ed-cb0c-5a26-8df8-038956215375, identifier: GV71%20PYT
2026-03-28 11:10:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 31de69ed-cb0c-5a26-8df8-038956215375 with identifier: GV71%20PYT
2026-03-28 11:10:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 31de69ed-cb0c-5a26-8df8-038956215375 with identifier: GV71%20PYT
2026-03-28 11:10:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 31de69ed-cb0c-5a26-8df8-038956215375 with identifier: GV71%20PYT to the API
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=20&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 44,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GV71%20PYT-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '31de69ed-cb0c-5a26-8df8-038956215375',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'GV71 PYT',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GV71%20PYT&vehicleType=*',
'listing': 'directbuy',
'location': 'Thurleigh',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 32850,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 18100,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 1.5 P300E 4WD R-DYNAMIC S Hatchback',
'transmission': 'automatic',
'trim': 'P300E 4WD R-DYNAMIC S',
'vin': 'SALZA2AT7NH171130',
'year': 2022}
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV71%2520PYT%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Saving data for GV71%20PYT: {'auction_closing_time': 1774854000.0, 'created_time': 1773837724.268671, 'last_price_update_time': 1774696231.575009}
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GV71%2520PYT') HTTP/1.1" 204 0
2026-03-28 11:10:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: HF21%20UKM
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF21%2520UKM%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for HF21%20UKM: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: HK72%20LDL
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK72%2520LDL%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for HK72%20LDL: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: KR71%20YZK
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520YZK%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for KR71%20YZK: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LE21%20ONP
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LE21%2520ONP%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LE21%20ONP: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LJ21%20ANZ
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ21%2520ANZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LJ21%20ANZ: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LJ22%20YNM
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ22%2520YNM%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LJ22%20YNM: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LL73%20PTZ
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL73%2520PTZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LL73%20PTZ: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LM72%20OEH
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM72%2520OEH%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LM72%20OEH: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LN22%20XRO
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN22%2520XRO%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LN22%20XRO: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LN23%20XRZ
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN23%2520XRZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LN23%20XRZ: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LR22%20SKZ
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520SKZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LR22%20SKZ: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LR22%20WDE
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520WDE%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LR22%20WDE: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LS21%20UXD
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS21%2520UXD%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LS21%20UXD: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LT24%20SPZ
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT24%2520SPZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LT24%20SPZ: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: LY21%20FXP
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY21%2520FXP%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for LY21%20FXP: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: MA23%20LUR
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520LUR%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for MA23%20LUR: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: MA23%20UCM
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520UCM%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for MA23%20UCM: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: MF22%20THU
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520THU%27 HTTP/1.1" 200 None
2026-03-28 11:10:31 [bca.uk] INFO: Scrape type for MF22%20THU: 0
2026-03-28 11:10:31 [bca.uk] INFO: Found listing with ID: MF22%20UNL
2026-03-28 11:10:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF22%2520UNL%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MF22%20UNL: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: MJ21%20JYX
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ21%2520JYX%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MJ21%20JYX: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: MJ23%20GNK
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ23%2520GNK%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MJ23%20GNK: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: MJ24%20DYX
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ24%2520DYX%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MJ24%20DYX: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: MJ71%20NLT
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ71%2520NLT%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MJ71%20NLT: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: MV71%20KKN
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV71%2520KKN%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MV71%20KKN: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: MW71%20XLP
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW71%2520XLP%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for MW71%20XLP: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: NC21%20FCD
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC21%2520FCD%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for NC21%20FCD: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: NG23%20VZA
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG23%2520VZA%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for NG23%20VZA: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: NL23%20SYE
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL23%2520SYE%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for NL23%20SYE: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: NL72%20VLB
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL72%2520VLB%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for NL72%20VLB: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: OE72%20JDU
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE72%2520JDU%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for OE72%20JDU: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: OV23%20CVP
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520CVP%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for OV23%20CVP: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: OY25%20GNO
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY25%2520GNO%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for OY25%20GNO: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: PE71%20XBG
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE71%2520XBG%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for PE71%20XBG: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: RF70%20EGV
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF70%2520EGV%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for RF70%20EGV: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: RV23%20WJK
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV23%2520WJK%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for RV23%20WJK: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: SG22%20ORL
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG22%2520ORL%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for SG22%20ORL: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: SM22%20NNB
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM22%2520NNB%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for SM22%20NNB: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: VO23%20NNV
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO23%2520NNV%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for VO23%20NNV: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: WD24%20HDC
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD24%2520HDC%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for WD24%20HDC: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: WG72%20ORF
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG72%2520ORF%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for WG72%20ORF: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: WR71%20ZHH
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR71%2520ZHH%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for WR71%20ZHH: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: WX23%20GXK
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX23%2520GXK%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for WX23%20GXK: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: YK22%20TBV
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520TBV%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for YK22%20TBV: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: YK22%20TEO
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK22%2520TEO%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for YK22%20TEO: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: YK72%20UPF
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK72%2520UPF%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for YK72%20UPF: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: YP72%20NTM
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP72%2520NTM%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for YP72%20NTM: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: YR72%20HSU
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR72%2520HSU%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for YR72%20HSU: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: YT72%20CDF
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT72%2520CDF%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for YT72%20CDF: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: KS14%20BJJ
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS14%2520BJJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for KS14%20BJJ: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: NA63%20LLX
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA63%2520LLX%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for NA63%20LLX: 0
2026-03-28 11:10:32 [bca.uk] INFO: Found listing with ID: WP59%20WKJ
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP59%2520WKJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:32 [bca.uk] INFO: Scrape type for WP59%20WKJ: 0
2026-03-28 11:10:46 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:10:46 [bca.uk] INFO: Total items found: 100
2026-03-28 11:10:46 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded
2026-03-28 11:10:46 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:10:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: DU68%20ZPW
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU68%2520ZPW%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for DU68%20ZPW: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: FY60%20ZRJ
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY60%2520ZRJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for FY60%20ZRJ: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: WJ18%20YOH
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ18%2520YOH%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for WJ18%20YOH: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: HX14%20FFC
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX14%2520FFC%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for HX14%20FFC: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: FP66%20XYT
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP66%2520XYT%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for FP66%20XYT: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: LC16%20YNE
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520YNE%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for LC16%20YNE: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: LR67%20EWJ
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR67%2520EWJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for LR67%20EWJ: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: RC54%20MON
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RC54%2520MON%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for RC54%20MON: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: YY16%20SEO
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY16%2520SEO%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for YY16%20SEO: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: DL15%20CXP
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL15%2520CXP%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for DL15%20CXP: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: DY64%20FEV
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY64%2520FEV%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for DY64%20FEV: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: ET17%20HVJ
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET17%2520HVJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for ET17%20HVJ: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: PE68%20XAZ
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE68%2520XAZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for PE68%20XAZ: 0
2026-03-28 11:10:46 [bca.uk] INFO: Found listing with ID: HG65%20AUR
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG65%2520AUR%27 HTTP/1.1" 200 None
2026-03-28 11:10:46 [bca.uk] INFO: Scrape type for HG65%20AUR: 2
2026-03-28 11:10:46 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c9eeccc7-c90c-534b-a860-d13c401bb736 with identifier: HG65%20AUR
2026-03-28 11:10:46 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c9eeccc7-c90c-534b-a860-d13c401bb736 with scrape type 2
2026-03-28 11:10:46 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c9eeccc7-c90c-534b-a860-d13c401bb736 with scrape type 2
2026-03-28 11:10:46 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c9eeccc7-c90c-534b-a860-d13c401bb736, identifier: HG65%20AUR
2026-03-28 11:10:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:46 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:10:46 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c9eeccc7-c90c-534b-a860-d13c401bb736 with identifier: HG65%20AUR
2026-03-28 11:10:46 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c9eeccc7-c90c-534b-a860-d13c401bb736 with identifier: HG65%20AUR
2026-03-28 11:10:46 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c9eeccc7-c90c-534b-a860-d13c401bb736 with identifier: HG65%20AUR to the API
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:46 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:47 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 152,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HG65%20AUR-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c9eeccc7-c90c-534b-a860-d13c401bb736',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'HG65 AUR',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HG65%20AUR&vehicleType=*',
'listing': 'auction',
'location': 'Brighouse',
'make': 'VAUXHALL',
'model': 'ASTRA',
'odometer': 98422,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL ASTRA 1.6 16V 115 EXCITE Hatchback',
'transmission': 'manual',
'trim': '16V 115 EXCITE',
'vin': 'W0LPC6ED3FG102931',
'year': 2015}
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG65%2520AUR%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Saving data for HG65%20AUR: {'auction_closing_time': 1774778400.0, 'created_time': 1774419061.371234, 'last_price_update_time': 1774696247.082399}
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HG65%2520AUR') HTTP/1.1" 204 0
2026-03-28 11:10:47 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: NL14%20CZM
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL14%2520CZM%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for NL14%20CZM: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: SE14%20HLX
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE14%2520HLX%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for SE14%20HLX: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: SW15%20DBY
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520DBY%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for SW15%20DBY: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: VU64%20OMG
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU64%2520OMG%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for VU64%20OMG: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: YS64%20XOK
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS64%2520XOK%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for YS64%20XOK: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: BG16%20WDZ
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG16%2520WDZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for BG16%20WDZ: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: G19%20CRV
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27G19%2520CRV%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for G19%20CRV: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: GY58%20YRU
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY58%2520YRU%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for GY58%20YRU: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: BX20%20OGT
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BX20%2520OGT%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for BX20%20OGT: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: EA61%20YJB
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA61%2520YJB%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for EA61%20YJB: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: OY57%20WCL
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY57%2520WCL%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for OY57%20WCL: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: YE15%20JYC
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE15%2520JYC%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for YE15%20JYC: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: HT68%20DTX
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HT68%2520DTX%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for HT68%20DTX: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: N4%20FHD
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N4%2520FHD%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for N4%20FHD: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: YC68%20JHG
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC68%2520JHG%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for YC68%20JHG: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: FG18%20YVH
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG18%2520YVH%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for FG18%20YVH: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: AH13%20NEY
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AH13%2520NEY%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for AH13%20NEY: 0
2026-03-28 11:10:47 [bca.uk] INFO: Found listing with ID: VK14%20FOH
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520FOH%27 HTTP/1.1" 200 None
2026-03-28 11:10:47 [bca.uk] INFO: Scrape type for VK14%20FOH: 2
2026-03-28 11:10:47 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH
2026-03-28 11:10:47 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53746d5e-fdae-5e1c-9a63-6bad5724b128 with scrape type 2
2026-03-28 11:10:47 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53746d5e-fdae-5e1c-9a63-6bad5724b128 with scrape type 2
2026-03-28 11:10:47 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53746d5e-fdae-5e1c-9a63-6bad5724b128, identifier: VK14%20FOH
2026-03-28 11:10:47 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH
2026-03-28 11:10:47 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH
2026-03-28 11:10:47 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53746d5e-fdae-5e1c-9a63-6bad5724b128 with identifier: VK14%20FOH to the API
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:47 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 131,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VK14%20FOH-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.4L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53746d5e-fdae-5e1c-9a63-6bad5724b128',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VK14 FOH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VK14%20FOH&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'ALFA ROMEO',
'model': 'GIULIETTA',
'odometer': 115065,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'ALFA ROMEO GIULIETTA 1.4 TB M/AIR 170 DISTINCTIVE Hatchback',
'transmission': 'manual',
'trim': 'TB M/AIR 170 DISTINCTIVE',
'vin': 'ZAR94000007319412',
'year': 2014}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK14%2520FOH%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [bca.uk] INFO: Saving data for VK14%20FOH: {'auction_closing_time': 1774778400.0, 'created_time': 1774217228.141147, 'last_price_update_time': 1774696248.072785}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VK14%2520FOH') HTTP/1.1" 204 0
2026-03-28 11:10:48 [bca.uk] INFO: Found listing with ID: VU67%20YNN
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU67%2520YNN%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [bca.uk] INFO: Scrape type for VU67%20YNN: 2
2026-03-28 11:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f with identifier: VU67%20YNN
2026-03-28 11:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f, identifier: VU67%20YNN
2026-03-28 11:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f with identifier: VU67%20YNN
2026-03-28 11:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f with identifier: VU67%20YNN
2026-03-28 11:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 26f1d05f-0c7b-53f4-91d0-bd54595a4d3f with identifier: VU67%20YNN to the API
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:48 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=VU67%20YNN-GB',
'category': 'Car',
'color': 'silver',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': '26f1d05f-0c7b-53f4-91d0-bd54595a4d3f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'VU67 YNN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=VU67%20YNN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'VENGA',
'odometer': 101080,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'KIA VENGA 1.6 3 ISG Hatchback',
'transmission': 'manual',
'trim': '3 ISG',
'vin': 'U5YEH812LHL169294',
'year': 2017}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VU67%2520YNN%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [bca.uk] INFO: Saving data for VU67%20YNN: {'auction_closing_time': 1774778400.0, 'created_time': 1774418772.123615, 'last_price_update_time': 1774696248.616629}
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='VU67%2520YNN') HTTP/1.1" 204 0
2026-03-28 11:10:48 [bca.uk] INFO: Found listing with ID: YK16%20YBE
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YK16%2520YBE%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [bca.uk] INFO: Scrape type for YK16%20YBE: 0
2026-03-28 11:10:48 [bca.uk] INFO: Found listing with ID: YP15%20RXZ
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP15%2520RXZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [bca.uk] INFO: Scrape type for YP15%20RXZ: 0
2026-03-28 11:10:48 [bca.uk] INFO: Found listing with ID: EK66%20XSM
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK66%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 11:10:48 [bca.uk] INFO: Scrape type for EK66%20XSM: 2
2026-03-28 11:10:48 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42 with identifier: EK66%20XSM
2026-03-28 11:10:48 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42 with scrape type 2
2026-03-28 11:10:48 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42, identifier: EK66%20XSM
2026-03-28 11:10:48 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42 with identifier: EK66%20XSM
2026-03-28 11:10:48 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42 with identifier: EK66%20XSM
2026-03-28 11:10:48 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42 with identifier: EK66%20XSM to the API
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:48 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 107,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EK66%20XSM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd4a67ecc-fc0a-5ba7-a9e4-d2c4571e2f42',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EK66 XSM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EK66%20XSM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'DS AUTOMOBILES',
'model': 'DS 3',
'odometer': 50918,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 3 1.2 P/T 82 CHIC Hatchback',
'transmission': 'manual',
'trim': 'P/T 82 CHIC',
'vin': 'VF7SAHMZ6GW621269',
'year': 2016}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK66%2520XSM%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Saving data for EK66%20XSM: {'auction_closing_time': 1774778400.0, 'created_time': 1774418796.877735, 'last_price_update_time': 1774696249.114032}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EK66%2520XSM') HTTP/1.1" 204 0
2026-03-28 11:10:49 [bca.uk] INFO: Found listing with ID: GN65%20MLV
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN65%2520MLV%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Scrape type for GN65%20MLV: 2
2026-03-28 11:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 018eb27f-061f-5cfa-b757-8088c3545930 with identifier: GN65%20MLV
2026-03-28 11:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 018eb27f-061f-5cfa-b757-8088c3545930 with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 018eb27f-061f-5cfa-b757-8088c3545930 with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 018eb27f-061f-5cfa-b757-8088c3545930, identifier: GN65%20MLV
2026-03-28 11:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 018eb27f-061f-5cfa-b757-8088c3545930 with identifier: GN65%20MLV
2026-03-28 11:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 018eb27f-061f-5cfa-b757-8088c3545930 with identifier: GN65%20MLV
2026-03-28 11:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 018eb27f-061f-5cfa-b757-8088c3545930 with identifier: GN65%20MLV to the API
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:49 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GN65%20MLV-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '018eb27f-061f-5cfa-b757-8088c3545930',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GN65 MLV',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GN65%20MLV&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'S-MAX',
'odometer': 79910,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'FORD S-MAX 2.0 TDCI 120 ZETEC MPV',
'transmission': 'manual',
'trim': 'TDCI 120 ZETEC',
'vin': 'WF0JXXWPCJFT31623',
'year': 2015}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN65%2520MLV%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Saving data for GN65%20MLV: {'auction_closing_time': 1774778400.0, 'created_time': 1774418788.547214, 'last_price_update_time': 1774696249.623192}
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GN65%2520MLV') HTTP/1.1" 204 0
2026-03-28 11:10:49 [bca.uk] INFO: Found listing with ID: HN16%20FEM
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN16%2520FEM%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Scrape type for HN16%20FEM: 0
2026-03-28 11:10:49 [bca.uk] INFO: Found listing with ID: NG14%20TWX
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG14%2520TWX%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Scrape type for NG14%20TWX: 0
2026-03-28 11:10:49 [bca.uk] INFO: Found listing with ID: OV16%20KRE
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV16%2520KRE%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Scrape type for OV16%20KRE: 0
2026-03-28 11:10:49 [bca.uk] INFO: Found listing with ID: PF16%20GYX
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF16%2520GYX%27 HTTP/1.1" 200 None
2026-03-28 11:10:49 [bca.uk] INFO: Scrape type for PF16%20GYX: 2
2026-03-28 11:10:49 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 732b4768-609e-5bb7-adcb-a56b74e4348d with identifier: PF16%20GYX
2026-03-28 11:10:49 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 732b4768-609e-5bb7-adcb-a56b74e4348d with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 732b4768-609e-5bb7-adcb-a56b74e4348d with scrape type 2
2026-03-28 11:10:49 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 732b4768-609e-5bb7-adcb-a56b74e4348d, identifier: PF16%20GYX
2026-03-28 11:10:49 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 732b4768-609e-5bb7-adcb-a56b74e4348d with identifier: PF16%20GYX
2026-03-28 11:10:49 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 732b4768-609e-5bb7-adcb-a56b74e4348d with identifier: PF16%20GYX
2026-03-28 11:10:49 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 732b4768-609e-5bb7-adcb-a56b74e4348d with identifier: PF16%20GYX to the API
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:10:49 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:10:50 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=21&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PF16%20GYX-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-29T10:00:00Z',
'fuel_type': 'Diesel',
'id': '732b4768-609e-5bb7-adcb-a56b74e4348d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'PF16 GYX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PF16%20GYX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'DS AUTOMOBILES',
'model': 'DS 4',
'odometer': 82797,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'DS AUTOMOBILES DS 4 1.6 BLUEHDI 120 ELEGANCE Hatchback',
'transmission': 'manual',
'trim': 'BLUEHDI 120 ELEGANCE',
'vin': 'VF7NXBHZMGY534297',
'year': 2016}
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF16%2520GYX%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Saving data for PF16%20GYX: {'auction_closing_time': 1774778400.0, 'created_time': 1774217065.297257, 'last_price_update_time': 1774696250.108911}
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PF16%2520GYX') HTTP/1.1" 204 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: RE17%20OYR
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE17%2520OYR%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for RE17%20OYR: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: RO17%20UUB
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO17%2520UUB%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for RO17%20UUB: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: SB17%20NXA
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB17%2520NXA%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for SB17%20NXA: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: UIG%202744
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27UIG%25202744%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for UIG%202744: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: VE17%20HYF
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE17%2520HYF%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for VE17%20HYF: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: AF64%20AWM
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF64%2520AWM%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for AF64%20AWM: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: AJ64%20PTU
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ64%2520PTU%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for AJ64%20PTU: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: DU64%20BVB
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU64%2520BVB%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for DU64%20BVB: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: VO63%20XSD
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO63%2520XSD%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for VO63%20XSD: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: FV13%20YPL
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV13%2520YPL%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for FV13%20YPL: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: KR63%20ZRG
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR63%2520ZRG%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for KR63%20ZRG: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: PY14%20EBA
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY14%2520EBA%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for PY14%20EBA: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: KT15%20GYV
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT15%2520GYV%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for KT15%20GYV: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: SG13%20UOY
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG13%2520UOY%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for SG13%20UOY: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: KU17%20ZLW
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU17%2520ZLW%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for KU17%20ZLW: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: KF68%20LCE
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF68%2520LCE%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for KF68%20LCE: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: EA18%20YDV
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA18%2520YDV%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for EA18%20YDV: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: OO67%20KEZ
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OO67%2520KEZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for OO67%20KEZ: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: RF68%20YKB
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF68%2520YKB%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for RF68%20YKB: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: GU65%20UKH
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU65%2520UKH%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for GU65%20UKH: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: KT67%20RDO
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT67%2520RDO%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for KT67%20RDO: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: LN16%20WFY
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN16%2520WFY%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for LN16%20WFY: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: SM70%20LKK
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM70%2520LKK%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for SM70%20LKK: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: AO65%20YFV
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO65%2520YFV%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for AO65%20YFV: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: BN67%20LSL
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN67%2520LSL%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for BN67%20LSL: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: AK60%20PLZ
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK60%2520PLZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for AK60%20PLZ: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: LT10%20XJA
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT10%2520XJA%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for LT10%20XJA: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: VN12%20XCH
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN12%2520XCH%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for VN12%20XCH: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: ML63%20NKT
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML63%2520NKT%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for ML63%20NKT: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: DC65%20VLJ
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC65%2520VLJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for DC65%20VLJ: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: DX68%20HXN
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX68%2520HXN%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for DX68%20HXN: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: RX56%20XOZ
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX56%2520XOZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for RX56%20XOZ: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: WR58%20YUW
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR58%2520YUW%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for WR58%20YUW: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: WA20%20YHO
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA20%2520YHO%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for WA20%20YHO: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: Y20%20RDE
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y20%2520RDE%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for Y20%20RDE: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: YA12%20PDK
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA12%2520PDK%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for YA12%20PDK: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: YJ63%20CVO
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ63%2520CVO%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for YJ63%20CVO: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: YP60%20UFT
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP60%2520UFT%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for YP60%20UFT: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: FV64%20UGS
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV64%2520UGS%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for FV64%20UGS: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: GJ62%20OWW
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ62%2520OWW%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for GJ62%20OWW: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: HD66%20AYV
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD66%2520AYV%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for HD66%20AYV: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: HX65%20VZY
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX65%2520VZY%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for HX65%20VZY: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: KN60%20UXA
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN60%2520UXA%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for KN60%20UXA: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: LC62%20ENO
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC62%2520ENO%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for LC62%20ENO: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: LS18%20GSV
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS18%2520GSV%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for LS18%20GSV: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: MV17%20GRK
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV17%2520GRK%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for MV17%20GRK: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: BG12%20YSA
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG12%2520YSA%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for BG12%20YSA: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: BJ59%20YSS
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ59%2520YSS%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for BJ59%20YSS: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: BP06%20UJK
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP06%2520UJK%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for BP06%20UJK: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: BV17%20NCY
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV17%2520NCY%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for BV17%20NCY: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: DE18%20HKD
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE18%2520HKD%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for DE18%20HKD: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: EA65%20ZCT
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA65%2520ZCT%27 HTTP/1.1" 200 None
2026-03-28 11:10:50 [bca.uk] INFO: Scrape type for EA65%20ZCT: 0
2026-03-28 11:10:50 [bca.uk] INFO: Found listing with ID: EX06%20UKK
2026-03-28 11:10:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX06%2520UKK%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for EX06%20UKK: 0
2026-03-28 11:10:51 [bca.uk] INFO: Found listing with ID: DG67%20VFW
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG67%2520VFW%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for DG67%20VFW: 0
2026-03-28 11:10:51 [bca.uk] INFO: Found listing with ID: FT12%20FXJ
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT12%2520FXJ%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for FT12%20FXJ: 0
2026-03-28 11:10:51 [bca.uk] INFO: Found listing with ID: RK63%20MWY
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK63%2520MWY%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for RK63%20MWY: 0
2026-03-28 11:10:51 [bca.uk] INFO: Found listing with ID: RV12%20MMU
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV12%2520MMU%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for RV12%20MMU: 0
2026-03-28 11:10:51 [bca.uk] INFO: Found listing with ID: AE63%20YYL
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE63%2520YYL%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for AE63%20YYL: 0
2026-03-28 11:10:51 [bca.uk] INFO: Found listing with ID: LC16%20NGZ
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:10:51 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC16%2520NGZ%27 HTTP/1.1" 200 None
2026-03-28 11:10:51 [bca.uk] INFO: Scrape type for LC16%20NGZ: 0
2026-03-28 11:11:10 [scrapy.extensions.logstats] INFO: Crawled 208 pages (at 3 pages/min), scraped 465 items (at 18 items/min)
2026-03-28 11:11:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:11:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:11:57 [bca.uk] INFO: Total items found: 100
2026-03-28 11:11:57 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded
2026-03-28 11:11:57 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:11:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: LN59%20YGP
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN59%2520YGP%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for LN59%20YGP: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: NC54%20KGO
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC54%2520KGO%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for NC54%20KGO: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: WD64%20EXR
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD64%2520EXR%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for WD64%20EXR: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: BN60%20OLC
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN60%2520OLC%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for BN60%20OLC: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: DA59%20JYT
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA59%2520JYT%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for DA59%20JYT: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: DN65%20HSO
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN65%2520HSO%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for DN65%20HSO: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: FE60%20VKH
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE60%2520VKH%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for FE60%20VKH: 0
2026-03-28 11:11:57 [bca.uk] INFO: Found listing with ID: GU14%20OGB
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:57 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520OGB%27 HTTP/1.1" 200 None
2026-03-28 11:11:57 [bca.uk] INFO: Scrape type for GU14%20OGB: 2
2026-03-28 11:11:57 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4dbe8966-26d8-59e1-b9fb-18ce10289425 with identifier: GU14%20OGB
2026-03-28 11:11:57 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4dbe8966-26d8-59e1-b9fb-18ce10289425 with scrape type 2
2026-03-28 11:11:57 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4dbe8966-26d8-59e1-b9fb-18ce10289425 with scrape type 2
2026-03-28 11:11:57 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4dbe8966-26d8-59e1-b9fb-18ce10289425, identifier: GU14%20OGB
2026-03-28 11:11:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:11:57 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:11:57 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4dbe8966-26d8-59e1-b9fb-18ce10289425 with identifier: GU14%20OGB
2026-03-28 11:11:57 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4dbe8966-26d8-59e1-b9fb-18ce10289425 with identifier: GU14%20OGB
2026-03-28 11:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4dbe8966-26d8-59e1-b9fb-18ce10289425 with identifier: GU14%20OGB to the API
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=GU14%20OGB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '4dbe8966-26d8-59e1-b9fb-18ce10289425',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'GU14 OGB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=GU14%20OGB&vehicleType=*',
'listing': 'auction',
'location': 'Preston',
'make': 'VAUXHALL',
'model': 'MERIVA',
'odometer': 69835,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'VAUXHALL MERIVA 1.6 CDTI 136 EXCLUSIV MPV',
'transmission': 'manual',
'trim': 'CDTI 136 EXCLUSIV',
'vin': 'W0LSD9ES7E4153680',
'year': 2014}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU14%2520OGB%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Saving data for GU14%20OGB: {'auction_closing_time': 1774951200.0, 'created_time': 1773829050.096014, 'last_price_update_time': 1774696318.320064}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='GU14%2520OGB') HTTP/1.1" 204 0
2026-03-28 11:11:58 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: VA16%20LRV
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA16%2520LRV%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for VA16%20LRV: 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: AO12%20GNP
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO12%2520GNP%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for AO12%20GNP: 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: BK64%20AOB
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520AOB%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for BK64%20AOB: 2
2026-03-28 11:11:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d10fc625-992b-5f86-9bf1-f20fff7dea9b with identifier: BK64%20AOB
2026-03-28 11:11:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d10fc625-992b-5f86-9bf1-f20fff7dea9b with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d10fc625-992b-5f86-9bf1-f20fff7dea9b with scrape type 2
2026-03-28 11:11:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d10fc625-992b-5f86-9bf1-f20fff7dea9b, identifier: BK64%20AOB
2026-03-28 11:11:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d10fc625-992b-5f86-9bf1-f20fff7dea9b with identifier: BK64%20AOB
2026-03-28 11:11:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d10fc625-992b-5f86-9bf1-f20fff7dea9b with identifier: BK64%20AOB
2026-03-28 11:11:58 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d10fc625-992b-5f86-9bf1-f20fff7dea9b with identifier: BK64%20AOB to the API
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:11:58 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BK64%20AOB-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'd10fc625-992b-5f86-9bf1-f20fff7dea9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'BK64 AOB',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BK64%20AOB&vehicleType=*',
'listing': 'auction',
'location': 'Crawley',
'make': 'NISSAN',
'model': 'NOTE',
'odometer': 85885,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN NOTE 1.2 DIG-S ACENTA PREMIUM Hatchback',
'transmission': 'automatic',
'trim': 'DIG-S ACENTA PREMIUM',
'vin': 'SJNTBAE12U1077599',
'year': 2014}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK64%2520AOB%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Saving data for BK64%20AOB: {'auction_closing_time': 1774951200.0, 'created_time': 1773933136.807833, 'last_price_update_time': 1774696318.886989}
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BK64%2520AOB') HTTP/1.1" 204 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: DU67%20LVD
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU67%2520LVD%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for DU67%20LVD: 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: EK56%20PGO
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK56%2520PGO%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for EK56%20PGO: 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: EN59%20AMK
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN59%2520AMK%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for EN59%20AMK: 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: EY08%20YGX
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY08%2520YGX%27 HTTP/1.1" 200 None
2026-03-28 11:11:58 [bca.uk] INFO: Scrape type for EY08%20YGX: 0
2026-03-28 11:11:58 [bca.uk] INFO: Found listing with ID: LF61%20YNV
2026-03-28 11:11:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF61%2520YNV%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LF61%20YNV: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: LS06%20OUH
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS06%2520OUH%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LS06%20OUH: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: NU66%20PYW
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU66%2520PYW%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for NU66%20PYW: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: PE58%20NTM
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PE58%2520NTM%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for PE58%20NTM: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: VN68%20KUJ
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN68%2520KUJ%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for VN68%20KUJ: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: NL23%20SUU
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL23%2520SUU%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for NL23%20SUU: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: EU15%20YBM
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU15%2520YBM%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for EU15%20YBM: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: GK19%20YXX
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK19%2520YXX%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for GK19%20YXX: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: CV06%20ZKK
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV06%2520ZKK%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for CV06%20ZKK: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: GF57%20UHV
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF57%2520UHV%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for GF57%20UHV: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: BG08%20KAK
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG08%2520KAK%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for BG08%20KAK: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: YP58%20TBU
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP58%2520TBU%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for YP58%20TBU: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: HG07%20WOA
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG07%2520WOA%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for HG07%20WOA: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: KC57%20UUR
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KC57%2520UUR%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for KC57%20UUR: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: KG05%20BVL
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KG05%2520BVL%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for KG05%20BVL: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: LA56%20LHG
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA56%2520LHG%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LA56%20LHG: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: LC05%20LHB
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC05%2520LHB%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LC05%20LHB: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: LG61%20WYL
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG61%2520WYL%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LG61%20WYL: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: LV13%20WFN
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520WFN%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LV13%20WFN: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: MJ61%20XRS
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ61%2520XRS%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for MJ61%20XRS: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: NA69%20XBT
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA69%2520XBT%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for NA69%20XBT: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: SD13%20SXO
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD13%2520SXO%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for SD13%20SXO: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: SG09%20FNU
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG09%2520FNU%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for SG09%20FNU: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: SM61%20URB
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM61%2520URB%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for SM61%20URB: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: VF07%20KYX
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VF07%2520KYX%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for VF07%20KYX: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: WG63%20YYE
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG63%2520YYE%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for WG63%20YYE: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: WJ07%20XUC
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ07%2520XUC%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for WJ07%20XUC: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: DF14%20TKV
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF14%2520TKV%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for DF14%20TKV: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: DU16%20VYC
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU16%2520VYC%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for DU16%20VYC: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: EJ14%20VDR
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ14%2520VDR%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for EJ14%20VDR: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: GJ61%20FMC
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ61%2520FMC%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for GJ61%20FMC: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: GU64%20NXK
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU64%2520NXK%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for GU64%20NXK: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: HD07%20EZL
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HD07%2520EZL%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for HD07%20EZL: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: FP17%20UOB
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP17%2520UOB%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for FP17%20UOB: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: RY56%20RNF
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY56%2520RNF%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for RY56%20RNF: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: VK23%20RVT
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK23%2520RVT%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for VK23%20RVT: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: FV59%20MFZ
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV59%2520MFZ%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for FV59%20MFZ: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: GX63%20OJP
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX63%2520OJP%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for GX63%20OJP: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: KS58%20OPT
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS58%2520OPT%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for KS58%20OPT: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: LM62%20GWZ
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520GWZ%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for LM62%20GWZ: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: MJ62%20EOL
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ62%2520EOL%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for MJ62%20EOL: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: NJ60%20NMX
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ60%2520NMX%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for NJ60%20NMX: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: SH18%20GZJ
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH18%2520GZJ%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for SH18%20GZJ: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: AC59%20DAC
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AC59%2520DAC%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for AC59%20DAC: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: FD63%20KVK
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD63%2520KVK%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for FD63%20KVK: 0
2026-03-28 11:11:59 [bca.uk] INFO: Found listing with ID: FL72%20ZHH
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:11:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL72%2520ZHH%27 HTTP/1.1" 200 None
2026-03-28 11:11:59 [bca.uk] INFO: Scrape type for FL72%20ZHH: 2
2026-03-28 11:11:59 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: bdddea0f-e5d5-597d-b832-d85eb21e4f82 with identifier: FL72%20ZHH
2026-03-28 11:11:59 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item bdddea0f-e5d5-597d-b832-d85eb21e4f82 with scrape type 2
2026-03-28 11:11:59 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item bdddea0f-e5d5-597d-b832-d85eb21e4f82 with scrape type 2
2026-03-28 11:12:00 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: bdddea0f-e5d5-597d-b832-d85eb21e4f82, identifier: FL72%20ZHH
2026-03-28 11:12:00 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: bdddea0f-e5d5-597d-b832-d85eb21e4f82 with identifier: FL72%20ZHH
2026-03-28 11:12:00 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: bdddea0f-e5d5-597d-b832-d85eb21e4f82 with identifier: FL72%20ZHH
2026-03-28 11:12:00 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: bdddea0f-e5d5-597d-b832-d85eb21e4f82 with identifier: FL72%20ZHH to the API
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:00 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=22&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=FL72%20ZHH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'bdddea0f-e5d5-597d-b832-d85eb21e4f82',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'FL72 ZHH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=FL72%20ZHH&vehicleType=*',
'listing': 'auction',
'location': 'Nottingham',
'make': 'SKODA',
'model': 'FABIA',
'odometer': 18499,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'SKODA FABIA 1.0 MPI 80 SE COMFORT Hatchback',
'transmission': 'manual',
'trim': 'MPI 80 SE COMFORT',
'vin': 'TMBFE6PJ6P4009690',
'year': 2022}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL72%2520ZHH%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Saving data for FL72%20ZHH: {'auction_closing_time': 1774951200.0, 'created_time': 1773844487.492502, 'last_price_update_time': 1774696320.362217}
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='FL72%2520ZHH') HTTP/1.1" 204 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: BJ66%20NYU
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ66%2520NYU%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for BJ66%20NYU: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: SW13%20EBX
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW13%2520EBX%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for SW13%20EBX: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: VN66%20YVE
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN66%2520YVE%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for VN66%20YVE: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: SH57%20NLP
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH57%2520NLP%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for SH57%20NLP: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: FD69%20ZHX
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FD69%2520ZHX%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for FD69%20ZHX: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: EK57%20YWZ
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK57%2520YWZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for EK57%20YWZ: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: PF67%20ENX
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF67%2520ENX%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for PF67%20ENX: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: WP14%20FBF
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP14%2520FBF%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for WP14%20FBF: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: WT16%20KKB
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WT16%2520KKB%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for WT16%20KKB: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YB66%20CAV
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB66%2520CAV%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YB66%20CAV: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YP61%20WOR
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP61%2520WOR%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YP61%20WOR: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YX14%20ORY
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX14%2520ORY%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YX14%20ORY: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: SY10%20OOD
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY10%2520OOD%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for SY10%20OOD: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: FY62%20VGM
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY62%2520VGM%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for FY62%20VGM: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: SH09%20CPE
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH09%2520CPE%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for SH09%20CPE: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: SV60%20MXJ
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV60%2520MXJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for SV60%20MXJ: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: FH10%20OZN
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FH10%2520OZN%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for FH10%20OZN: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: NX67%20XBD
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX67%2520XBD%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for NX67%20XBD: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: FV17%20ZVH
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV17%2520ZVH%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for FV17%20ZVH: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: NX14%20ZHM
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX14%2520ZHM%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for NX14%20ZHM: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: PJ16%20CME
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ16%2520CME%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for PJ16%20CME: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: FY09%20CJO
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY09%2520CJO%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for FY09%20CJO: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YS09%20GUK
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS09%2520GUK%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YS09%20GUK: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YM24%20JBU
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM24%2520JBU%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YM24%20JBU: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YG17%20ONF
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG17%2520ONF%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YG17%20ONF: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: YH61%20SGV
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH61%2520SGV%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for YH61%20SGV: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: DN58%20UWL
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN58%2520UWL%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for DN58%20UWL: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: NJ09%20OGF
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ09%2520OGF%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for NJ09%20OGF: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: PK12%20TXL
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK12%2520TXL%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for PK12%20TXL: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: PX08%20GWJ
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX08%2520GWJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for PX08%20GWJ: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: RF12%20FYR
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF12%2520FYR%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for RF12%20FYR: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: WG19%20UHJ
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG19%2520UHJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for WG19%20UHJ: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: WP62%20XYU
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP62%2520XYU%27 HTTP/1.1" 200 None
2026-03-28 11:12:00 [bca.uk] INFO: Scrape type for WP62%20XYU: 0
2026-03-28 11:12:00 [bca.uk] INFO: Found listing with ID: GK60%20RPO
2026-03-28 11:12:00 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK60%2520RPO%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [bca.uk] INFO: Scrape type for GK60%20RPO: 0
2026-03-28 11:12:01 [bca.uk] INFO: Found listing with ID: PL73%20JNF
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL73%2520JNF%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [bca.uk] INFO: Scrape type for PL73%20JNF: 0
2026-03-28 11:12:01 [bca.uk] INFO: Found listing with ID: SL58%20KKF
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL58%2520KKF%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [bca.uk] INFO: Scrape type for SL58%20KKF: 0
2026-03-28 11:12:01 [bca.uk] INFO: Found listing with ID: RO22%20NRL
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520NRL%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [bca.uk] INFO: Scrape type for RO22%20NRL: 0
2026-03-28 11:12:01 [bca.uk] INFO: Found listing with ID: FG65%20XLO
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG65%2520XLO%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [bca.uk] INFO: Scrape type for FG65%20XLO: 0
2026-03-28 11:12:01 [bca.uk] INFO: Found listing with ID: FG68%20DDA
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:01 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG68%2520DDA%27 HTTP/1.1" 200 None
2026-03-28 11:12:01 [bca.uk] INFO: Scrape type for FG68%20DDA: 0
2026-03-28 11:12:05 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:05 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:05 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded
2026-03-28 11:12:05 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:05 [bca.uk] INFO: Found listing with ID: FJ14%20YWV
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ14%2520YWV%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [bca.uk] INFO: Scrape type for FJ14%20YWV: 0
2026-03-28 11:12:05 [bca.uk] INFO: Found listing with ID: KN19%20TJW
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN19%2520TJW%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [bca.uk] INFO: Scrape type for KN19%20TJW: 2
2026-03-28 11:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 53a6d89f-9b82-5a91-95d3-5453b16c6a66 with identifier: KN19%20TJW
2026-03-28 11:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 53a6d89f-9b82-5a91-95d3-5453b16c6a66 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 53a6d89f-9b82-5a91-95d3-5453b16c6a66 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 53a6d89f-9b82-5a91-95d3-5453b16c6a66, identifier: KN19%20TJW
2026-03-28 11:12:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:05 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:05 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 53a6d89f-9b82-5a91-95d3-5453b16c6a66 with identifier: KN19%20TJW
2026-03-28 11:12:05 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 53a6d89f-9b82-5a91-95d3-5453b16c6a66 with identifier: KN19%20TJW
2026-03-28 11:12:05 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 53a6d89f-9b82-5a91-95d3-5453b16c6a66 with identifier: KN19%20TJW to the API
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:05 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 118,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KN19%20TJW-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '53a6d89f-9b82-5a91-95d3-5453b16c6a66',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KN19 TJW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KN19%20TJW&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 46391,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2019-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 1.5 TSI EVO 150 GT DSG Estate',
'transmission': 'automatic',
'trim': 'TSI EVO 150 GT DSG',
'vin': 'WVWZZZAUZKP589627',
'year': 2019}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN19%2520TJW%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [bca.uk] INFO: Saving data for KN19%20TJW: {'auction_closing_time': 1774951200.0, 'created_time': 1774045375.39546, 'last_price_update_time': 1774696325.802656}
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KN19%2520TJW') HTTP/1.1" 204 0
2026-03-28 11:12:05 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:05 [bca.uk] INFO: Found listing with ID: SP12%20XJU
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:05 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520XJU%27 HTTP/1.1" 200 None
2026-03-28 11:12:05 [bca.uk] INFO: Scrape type for SP12%20XJU: 2
2026-03-28 11:12:05 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9 with identifier: SP12%20XJU
2026-03-28 11:12:05 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9 with scrape type 2
2026-03-28 11:12:05 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9 with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9, identifier: SP12%20XJU
2026-03-28 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9 with identifier: SP12%20XJU
2026-03-28 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9 with identifier: SP12%20XJU
2026-03-28 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9 with identifier: SP12%20XJU to the API
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 115,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SP12%20XJU-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'c13f4245-2d4b-5b73-bc93-40e7c4cb7ee9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SP12 XJU',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SP12%20XJU&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'NISSAN',
'model': 'MICRA',
'odometer': 132585,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'NISSAN MICRA 1.2 VISIA Hatchback',
'transmission': 'manual',
'trim': 'VISIA',
'vin': 'MDHFBUK13U0110011',
'year': 2012}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520XJU%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Saving data for SP12%20XJU: {'auction_closing_time': 1774951200.0, 'created_time': 1773932213.686087, 'last_price_update_time': 1774696326.370427}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SP12%2520XJU') HTTP/1.1" 204 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: SW15%20NYA
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW15%2520NYA%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for SW15%20NYA: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: Y676%20PLE
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y676%2520PLE%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for Y676%20PLE: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: DG13%20DVZ
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG13%2520DVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for DG13%20DVZ: 2
2026-03-28 11:12:06 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 7914db67-da20-5b10-8337-4618d537ab9b with identifier: DG13%20DVZ
2026-03-28 11:12:06 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 7914db67-da20-5b10-8337-4618d537ab9b with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 7914db67-da20-5b10-8337-4618d537ab9b with scrape type 2
2026-03-28 11:12:06 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 7914db67-da20-5b10-8337-4618d537ab9b, identifier: DG13%20DVZ
2026-03-28 11:12:06 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 7914db67-da20-5b10-8337-4618d537ab9b with identifier: DG13%20DVZ
2026-03-28 11:12:06 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 7914db67-da20-5b10-8337-4618d537ab9b with identifier: DG13%20DVZ
2026-03-28 11:12:06 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 7914db67-da20-5b10-8337-4618d537ab9b with identifier: DG13%20DVZ to the API
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:06 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DG13%20DVZ-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '7914db67-da20-5b10-8337-4618d537ab9b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DG13 DVZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DG13%20DVZ&vehicleType=*',
'listing': 'auction',
'location': 'Glasgow - East',
'make': 'MITSUBISHI',
'model': 'ASX',
'odometer': 246338,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2013-01-01',
'seller_name': None,
'title': 'MITSUBISHI ASX 1.6 2 CLEARTEC Estate',
'transmission': 'manual',
'trim': '2 CLEARTEC',
'vin': 'JMAXNGA1WCZ000673',
'year': 2013}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG13%2520DVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Saving data for DG13%20DVZ: {'auction_closing_time': 1774951200.0, 'created_time': 1774045371.647714, 'last_price_update_time': 1774696326.87522}
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DG13%2520DVZ') HTTP/1.1" 204 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: DL67%20NKJ
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL67%2520NKJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for DL67%20NKJ: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: NL12%20MVO
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL12%2520MVO%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for NL12%20MVO: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: GV68%20ULZ
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV68%2520ULZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for GV68%20ULZ: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: RJ22%20EBZ
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ22%2520EBZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for RJ22%20EBZ: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: DX16%20RWJ
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:06 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DX16%2520RWJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:06 [bca.uk] INFO: Scrape type for DX16%20RWJ: 0
2026-03-28 11:12:06 [bca.uk] INFO: Found listing with ID: EY64%20EXD
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY64%2520EXD%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for EY64%20EXD: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: KS64%20PHK
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS64%2520PHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for KS64%20PHK: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: BF08%20UUE
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF08%2520UUE%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for BF08%20UUE: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: EK59%20ZHH
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK59%2520ZHH%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for EK59%20ZHH: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: EN62%20ZKT
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN62%2520ZKT%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for EN62%20ZKT: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: LS14%20SFJ
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS14%2520SFJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for LS14%20SFJ: 2
2026-03-28 11:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 9bbdaa88-e122-557e-a178-19393606b75c with identifier: LS14%20SFJ
2026-03-28 11:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 9bbdaa88-e122-557e-a178-19393606b75c with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 9bbdaa88-e122-557e-a178-19393606b75c with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 9bbdaa88-e122-557e-a178-19393606b75c, identifier: LS14%20SFJ
2026-03-28 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 9bbdaa88-e122-557e-a178-19393606b75c with identifier: LS14%20SFJ
2026-03-28 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 9bbdaa88-e122-557e-a178-19393606b75c with identifier: LS14%20SFJ
2026-03-28 11:12:07 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 9bbdaa88-e122-557e-a178-19393606b75c with identifier: LS14%20SFJ to the API
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:07 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 113,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LS14%20SFJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '9bbdaa88-e122-557e-a178-19393606b75c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LS14 SFJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LS14%20SFJ&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'FIAT',
'model': '500',
'odometer': 53102,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'FIAT 500 1.2 S Hatchback',
'transmission': 'manual',
'trim': 'S',
'vin': 'ZFA3120000J173661',
'year': 2014}
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS14%2520SFJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Saving data for LS14%20SFJ: {'auction_closing_time': 1774951200.0, 'created_time': 1773844273.015875, 'last_price_update_time': 1774696327.523909}
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LS14%2520SFJ') HTTP/1.1" 204 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: LS54%20SVP
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS54%2520SVP%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for LS54%20SVP: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: LT11%20NGE
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT11%2520NGE%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for LT11%20NGE: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: LX12%20APO
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX12%2520APO%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for LX12%20APO: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: M60%20MSU
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27M60%2520MSU%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for M60%20MSU: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: MJ10%20HPE
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ10%2520HPE%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for MJ10%20HPE: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: MK14%20VLE
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK14%2520VLE%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for MK14%20VLE: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: NL61%20FOD
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL61%2520FOD%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for NL61%20FOD: 0
2026-03-28 11:12:07 [bca.uk] INFO: Found listing with ID: RJ17%20SVK
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:07 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ17%2520SVK%27 HTTP/1.1" 200 None
2026-03-28 11:12:07 [bca.uk] INFO: Scrape type for RJ17%20SVK: 2
2026-03-28 11:12:07 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f with identifier: RJ17%20SVK
2026-03-28 11:12:07 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f with scrape type 2
2026-03-28 11:12:07 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f, identifier: RJ17%20SVK
2026-03-28 11:12:07 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f with identifier: RJ17%20SVK
2026-03-28 11:12:07 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f with identifier: RJ17%20SVK
2026-03-28 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 18acdfb1-07cc-5e2f-a941-a6dbe4762f6f with identifier: RJ17%20SVK to the API
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RJ17%20SVK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '18acdfb1-07cc-5e2f-a941-a6dbe4762f6f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RJ17 SVK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RJ17%20SVK&vehicleType=*',
'listing': 'auction',
'location': 'Enfield',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 84813,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 75 LIMITED ED. Hatchback',
'transmission': 'manual',
'trim': '75 LIMITED ED.',
'vin': 'W0L0XEP08H6086497',
'year': 2017}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ17%2520SVK%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Saving data for RJ17%20SVK: {'auction_closing_time': 1774951200.0, 'created_time': 1774045333.473042, 'last_price_update_time': 1774696328.263912}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RJ17%2520SVK') HTTP/1.1" 204 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: SP13%20VCL
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP13%2520VCL%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for SP13%20VCL: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: VE16%20FUD
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE16%2520FUD%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for VE16%20FUD: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: BD16%20ZNJ
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD16%2520ZNJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for BD16%20ZNJ: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: BN63%20JDF
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN63%2520JDF%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for BN63%20JDF: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: DU12%20AXD
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU12%2520AXD%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for DU12%20AXD: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: EA19%20FCD
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA19%2520FCD%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for EA19%20FCD: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: GU62%20WMM
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU62%2520WMM%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for GU62%20WMM: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: GY14%20KTD
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY14%2520KTD%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for GY14%20KTD: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: KF05%20WVN
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF05%2520WVN%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for KF05%20WVN: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: LN11%20SXC
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN11%2520SXC%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for LN11%20SXC: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: SK13%20SOC
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520SOC%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for SK13%20SOC: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: WK14%20WOD
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK14%2520WOD%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for WK14%20WOD: 0
2026-03-28 11:12:08 [bca.uk] INFO: Found listing with ID: DL64%20MPX
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520MPX%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Scrape type for DL64%20MPX: 2
2026-03-28 11:12:08 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 4bc7619d-b97c-5380-a235-2eedae1023ce with identifier: DL64%20MPX
2026-03-28 11:12:08 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 4bc7619d-b97c-5380-a235-2eedae1023ce with scrape type 2
2026-03-28 11:12:08 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 4bc7619d-b97c-5380-a235-2eedae1023ce with scrape type 2
2026-03-28 11:12:08 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 4bc7619d-b97c-5380-a235-2eedae1023ce, identifier: DL64%20MPX
2026-03-28 11:12:08 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 4bc7619d-b97c-5380-a235-2eedae1023ce with identifier: DL64%20MPX
2026-03-28 11:12:08 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 4bc7619d-b97c-5380-a235-2eedae1023ce with identifier: DL64%20MPX
2026-03-28 11:12:08 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 4bc7619d-b97c-5380-a235-2eedae1023ce with identifier: DL64%20MPX to the API
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:08 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=23&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 129,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=DL64%20MPX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '4bc7619d-b97c-5380-a235-2eedae1023ce',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'DL64 MPX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=DL64%20MPX&vehicleType=*',
'listing': 'auction',
'location': 'Edinburgh',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 38152,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2015-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.2 VVT SXI Hatchback',
'transmission': 'manual',
'trim': 'VVT SXI',
'vin': 'W0L0SDL08E6120488',
'year': 2015}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520MPX%27 HTTP/1.1" 200 None
2026-03-28 11:12:08 [bca.uk] INFO: Saving data for DL64%20MPX: {'auction_closing_time': 1774951200.0, 'created_time': 1773930359.056099, 'last_price_update_time': 1774696328.950383}
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:08 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='DL64%2520MPX') HTTP/1.1" 204 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: SF16%20SMW
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF16%2520SMW%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for SF16%20SMW: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: AF66%20XYX
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF66%2520XYX%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for AF66%20XYX: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CK15%20YEG
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK15%2520YEG%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CK15%20YEG: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: EX14%20FSZ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX14%2520FSZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for EX14%20FSZ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: FE65%20UJU
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE65%2520UJU%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for FE65%20UJU: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: HK15%20VKT
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK15%2520VKT%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for HK15%20VKT: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: KV57%20GEK
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV57%2520GEK%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for KV57%20GEK: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: KY65%20TBU
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY65%2520TBU%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for KY65%20TBU: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: N13%20GWM
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27N13%2520GWM%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for N13%20GWM: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: PL14%20HJK
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PL14%2520HJK%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for PL14%20HJK: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: VE65%20YLT
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE65%2520YLT%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for VE65%20YLT: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: WG62%20WDW
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG62%2520WDW%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for WG62%20WDW: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: WU05%20WWZ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU05%2520WWZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for WU05%20WWZ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: AV17%20OEJ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV17%2520OEJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for AV17%20OEJ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CA62%20PRV
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA62%2520PRV%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CA62%20PRV: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CK18%20EYV
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520EYV%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CK18%20EYV: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CU65%20MXK
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU65%2520MXK%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CU65%20MXK: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CV58%20YNE
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV58%2520YNE%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CV58%20YNE: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CV64%20HRP
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520HRP%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CV64%20HRP: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: DG64%20SWO
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG64%2520SWO%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for DG64%20SWO: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: DN14%20GKA
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN14%2520GKA%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for DN14%20GKA: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: DN62%20GZL
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN62%2520GZL%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for DN62%20GZL: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: DN67%20DUH
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN67%2520DUH%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for DN67%20DUH: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: BC18%20CLU
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC18%2520CLU%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for BC18%20CLU: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: HF16%20FLG
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HF16%2520FLG%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for HF16%20FLG: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: AD56%20DJY
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AD56%2520DJY%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for AD56%20DJY: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: CE05%20VFX
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE05%2520VFX%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for CE05%20VFX: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: FR12%20PKZ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FR12%2520PKZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for FR12%20PKZ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: LR04%20NYG
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR04%2520NYG%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for LR04%20NYG: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: EN15%20YTY
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN15%2520YTY%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for EN15%20YTY: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: SJ07%20LJK
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ07%2520LJK%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for SJ07%20LJK: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: WG11%20KFJ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG11%2520KFJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for WG11%20KFJ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: WK59%20VGD
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK59%2520VGD%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for WK59%20VGD: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: WK61%20THG
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK61%2520THG%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for WK61%20THG: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: WV64%20PJX
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV64%2520PJX%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for WV64%20PJX: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: YE10%20LCX
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE10%2520LCX%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for YE10%20LCX: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: BR53%20NNR
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BR53%2520NNR%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for BR53%20NNR: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: DK10%20USC
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK10%2520USC%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for DK10%20USC: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: GY60%20KSU
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY60%2520KSU%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for GY60%20KSU: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: LR61%20CGG
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR61%2520CGG%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for LR61%20CGG: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: MA17%20EEJ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA17%2520EEJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for MA17%20EEJ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: NA10%20FLB
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA10%2520FLB%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for NA10%20FLB: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: RJ13%20ABV
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ13%2520ABV%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for RJ13%20ABV: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: KN71%20FCZ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520FCZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for KN71%20FCZ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: KN71%20FFC
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520FFC%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for KN71%20FFC: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: KN71%20FHS
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520FHS%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for KN71%20FHS: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: FE64%20FHS
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE64%2520FHS%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for FE64%20FHS: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: PY64%20DMO
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY64%2520DMO%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for PY64%20DMO: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: DV13%20YRE
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV13%2520YRE%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for DV13%20YRE: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: GF59%20YWE
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF59%2520YWE%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for GF59%20YWE: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: ND15%20CVZ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND15%2520CVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:09 [bca.uk] INFO: Scrape type for ND15%20CVZ: 0
2026-03-28 11:12:09 [bca.uk] INFO: Found listing with ID: YP17%20FUJ
2026-03-28 11:12:09 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP17%2520FUJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for YP17%20FUJ: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: YS17%20LHG
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS17%2520LHG%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for YS17%20LHG: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: FV67%20NKF
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV67%2520NKF%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for FV67%20NKF: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: KN67%20KNP
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN67%2520KNP%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for KN67%20KNP: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: LD66%20AWC
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD66%2520AWC%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for LD66%20AWC: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: OU64%20WSZ
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU64%2520WSZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for OU64%20WSZ: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: DA03%20RYT
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA03%2520RYT%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for DA03%20RYT: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: HK60%20FNC
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK60%2520FNC%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for HK60%20FNC: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: LG03%20ZTW
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LG03%2520ZTW%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for LG03%20ZTW: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: SM57%20UMV
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM57%2520UMV%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for SM57%20UMV: 0
2026-03-28 11:12:10 [bca.uk] INFO: Found listing with ID: VA12%20NWM
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:10 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VA12%2520NWM%27 HTTP/1.1" 200 None
2026-03-28 11:12:10 [bca.uk] INFO: Scrape type for VA12%20NWM: 0
2026-03-28 11:12:10 [scrapy.extensions.logstats] INFO: Crawled 210 pages (at 2 pages/min), scraped 474 items (at 9 items/min)
2026-03-28 11:12:10 [scrapy.extensions.memusage] INFO: Peak memory usage is 195MiB
2026-03-28 11:12:17 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:18 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:18 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded
2026-03-28 11:12:18 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: VE61%20YSX
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE61%2520YSX%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for VE61%20YSX: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: WF11%20YRA
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF11%2520YRA%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for WF11%20YRA: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: WP12%20KFK
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP12%2520KFK%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for WP12%20KFK: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: WU58%20MYB
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU58%2520MYB%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for WU58%20MYB: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: KP61%20YTC
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP61%2520YTC%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for KP61%20YTC: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: KR58%20KAE
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR58%2520KAE%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for KR58%20KAE: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: KV57%20OHT
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV57%2520OHT%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for KV57%20OHT: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: KY12%20OTH
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY12%2520OTH%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for KY12%20OTH: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: LC08%20BYV
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC08%2520BYV%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for LC08%20BYV: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: LC69%20YNW
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC69%2520YNW%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for LC69%20YNW: 0
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: LD62%20FVN
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520FVN%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for LD62%20FVN: 2
2026-03-28 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 217b8cd7-79f8-5ae1-8695-27d133a488f9 with identifier: LD62%20FVN
2026-03-28 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 217b8cd7-79f8-5ae1-8695-27d133a488f9 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 217b8cd7-79f8-5ae1-8695-27d133a488f9 with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 217b8cd7-79f8-5ae1-8695-27d133a488f9, identifier: LD62%20FVN
2026-03-28 11:12:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:18 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:18 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 217b8cd7-79f8-5ae1-8695-27d133a488f9 with identifier: LD62%20FVN
2026-03-28 11:12:18 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 217b8cd7-79f8-5ae1-8695-27d133a488f9 with identifier: LD62%20FVN
2026-03-28 11:12:18 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 217b8cd7-79f8-5ae1-8695-27d133a488f9 with identifier: LD62%20FVN to the API
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:18 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 100,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LD62%20FVN-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '217b8cd7-79f8-5ae1-8695-27d133a488f9',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LD62 FVN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LD62%20FVN&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'KIA',
'model': 'CEED',
'odometer': 140883,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2012-01-01',
'seller_name': None,
'title': 'KIA CEED 1.6 CRDI 126 E/D 3 Hatchback',
'transmission': 'manual',
'trim': 'CRDI 126 E/D 3',
'vin': 'U5YHN516LDL036686',
'year': 2012}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD62%2520FVN%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Saving data for LD62%20FVN: {'auction_closing_time': 1774951200.0, 'created_time': 1774045352.707732, 'last_price_update_time': 1774696338.870753}
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LD62%2520FVN') HTTP/1.1" 204 0
2026-03-28 11:12:18 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:18 [bca.uk] INFO: Found listing with ID: MC65%20YPK
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:18 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC65%2520YPK%27 HTTP/1.1" 200 None
2026-03-28 11:12:18 [bca.uk] INFO: Scrape type for MC65%20YPK: 2
2026-03-28 11:12:18 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff with identifier: MC65%20YPK
2026-03-28 11:12:18 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff with scrape type 2
2026-03-28 11:12:18 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff, identifier: MC65%20YPK
2026-03-28 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff with identifier: MC65%20YPK
2026-03-28 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff with identifier: MC65%20YPK
2026-03-28 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: d9dd2926-7cad-5d6f-84b9-65f6d8f0ebff with identifier: MC65%20YPK to the API
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 85,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MC65%20YPK-GB',
'category': 'Car',
'color': 'grey',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'd9dd2926-7cad-5d6f-84b9-65f6d8f0ebff',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MC65 YPK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MC65%20YPK&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'PEUGEOT',
'model': '308 SW',
'odometer': 119674,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'PEUGEOT 308 SW 1.6 BLUEHDI 120 ACTIVE Estate',
'transmission': 'manual',
'trim': 'BLUEHDI 120 ACTIVE',
'vin': 'VF3LCBHZHGS012510',
'year': 2016}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC65%2520YPK%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Saving data for MC65%20YPK: {'auction_closing_time': 1774951200.0, 'created_time': 1774044928.50141, 'last_price_update_time': 1774696339.431868}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MC65%2520YPK') HTTP/1.1" 204 0
2026-03-28 11:12:19 [bca.uk] INFO: Found listing with ID: MV59%20ZYR
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV59%2520ZYR%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Scrape type for MV59%20ZYR: 0
2026-03-28 11:12:19 [bca.uk] INFO: Found listing with ID: RJ61%20VZV
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ61%2520VZV%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Scrape type for RJ61%20VZV: 0
2026-03-28 11:12:19 [bca.uk] INFO: Found listing with ID: RO09%20DFE
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520DFE%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Scrape type for RO09%20DFE: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 1e96cf45-ed2d-573c-aec1-2e69dcc0422b with identifier: RO09%20DFE
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 1e96cf45-ed2d-573c-aec1-2e69dcc0422b with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 1e96cf45-ed2d-573c-aec1-2e69dcc0422b with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 1e96cf45-ed2d-573c-aec1-2e69dcc0422b, identifier: RO09%20DFE
2026-03-28 11:12:19 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 1e96cf45-ed2d-573c-aec1-2e69dcc0422b with identifier: RO09%20DFE
2026-03-28 11:12:19 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 1e96cf45-ed2d-573c-aec1-2e69dcc0422b with identifier: RO09%20DFE
2026-03-28 11:12:19 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 1e96cf45-ed2d-573c-aec1-2e69dcc0422b with identifier: RO09%20DFE to the API
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:19 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 158,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=RO09%20DFE-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '1e96cf45-ed2d-573c-aec1-2e69dcc0422b',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'RO09 DFE',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=RO09%20DFE&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'MERCEDES-BENZ',
'model': 'B180',
'odometer': 102035,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'MERCEDES-BENZ B180 2.0 CDI SPORT Hatchback',
'transmission': 'manual',
'trim': 'CDI SPORT',
'vin': 'WDD2452072J426785',
'year': 2009}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520DFE%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Saving data for RO09%20DFE: {'auction_closing_time': 1774951200.0, 'created_time': 1774044888.186751, 'last_price_update_time': 1774696339.897435}
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='RO09%2520DFE') HTTP/1.1" 204 0
2026-03-28 11:12:19 [bca.uk] INFO: Found listing with ID: DV67%20ZNZ
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV67%2520ZNZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Scrape type for DV67%20ZNZ: 0
2026-03-28 11:12:19 [bca.uk] INFO: Found listing with ID: EA09%20NJX
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:19 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA09%2520NJX%27 HTTP/1.1" 200 None
2026-03-28 11:12:19 [bca.uk] INFO: Scrape type for EA09%20NJX: 2
2026-03-28 11:12:19 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 07eff343-34a6-53eb-817b-f13af9b157a5 with identifier: EA09%20NJX
2026-03-28 11:12:19 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 07eff343-34a6-53eb-817b-f13af9b157a5 with scrape type 2
2026-03-28 11:12:19 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 07eff343-34a6-53eb-817b-f13af9b157a5 with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 07eff343-34a6-53eb-817b-f13af9b157a5, identifier: EA09%20NJX
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 07eff343-34a6-53eb-817b-f13af9b157a5 with identifier: EA09%20NJX
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 07eff343-34a6-53eb-817b-f13af9b157a5 with identifier: EA09%20NJX
2026-03-28 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 07eff343-34a6-53eb-817b-f13af9b157a5 with identifier: EA09%20NJX to the API
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 119,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=EA09%20NJX-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '07eff343-34a6-53eb-817b-f13af9b157a5',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'EA09 NJX',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=EA09%20NJX&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'FORD',
'model': 'KA',
'odometer': 67971,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2009-01-01',
'seller_name': None,
'title': 'FORD KA 1.2 STUDIO Hatchback',
'transmission': 'manual',
'trim': 'STUDIO',
'vin': 'WF0UXXLTRU9U34839',
'year': 2009}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA09%2520NJX%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Saving data for EA09%20NJX: {'auction_closing_time': 1774951200.0, 'created_time': 1774426245.212413, 'last_price_update_time': 1774696340.414438}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='EA09%2520NJX') HTTP/1.1" 204 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: EY13%20EWC
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY13%2520EWC%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for EY13%20EWC: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: GF13%20ZSN
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF13%2520ZSN%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for GF13%20ZSN: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: GK62%20SWZ
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK62%2520SWZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for GK62%20SWZ: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: GV68%20SRZ
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV68%2520SRZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for GV68%20SRZ: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: HG58%20ENY
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG58%2520ENY%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for HG58%20ENY: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: KN65%20XDZ
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN65%2520XDZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for KN65%20XDZ: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: KO18%20FFN
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KO18%2520FFN%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for KO18%20FFN: 0
2026-03-28 11:12:20 [bca.uk] INFO: Found listing with ID: KP11%20KHM
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP11%2520KHM%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Scrape type for KP11%20KHM: 2
2026-03-28 11:12:20 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8cba1122-a55c-51d4-825e-e4210ebe690e with identifier: KP11%20KHM
2026-03-28 11:12:20 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8cba1122-a55c-51d4-825e-e4210ebe690e with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8cba1122-a55c-51d4-825e-e4210ebe690e with scrape type 2
2026-03-28 11:12:20 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8cba1122-a55c-51d4-825e-e4210ebe690e, identifier: KP11%20KHM
2026-03-28 11:12:20 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8cba1122-a55c-51d4-825e-e4210ebe690e with identifier: KP11%20KHM
2026-03-28 11:12:20 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8cba1122-a55c-51d4-825e-e4210ebe690e with identifier: KP11%20KHM
2026-03-28 11:12:20 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8cba1122-a55c-51d4-825e-e4210ebe690e with identifier: KP11%20KHM to the API
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:20 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=KP11%20KHM-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Diesel',
'id': '8cba1122-a55c-51d4-825e-e4210ebe690e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'KP11 KHM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=KP11%20KHM&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'GOLF',
'odometer': 142598,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2011-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN GOLF 2.0 TDI 140 GT-L DSG Hatchback',
'transmission': 'automatic',
'trim': 'TDI 140 GT-L DSG',
'vin': 'WVWZZZ1KZBW268947',
'year': 2011}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP11%2520KHM%27 HTTP/1.1" 200 None
2026-03-28 11:12:20 [bca.uk] INFO: Saving data for KP11%20KHM: {'auction_closing_time': 1774951200.0, 'created_time': 1774426244.324788, 'last_price_update_time': 1774696340.976514}
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:20 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='KP11%2520KHM') HTTP/1.1" 204 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: FY11%20XAM
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY11%2520XAM%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for FY11%20XAM: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: PN13%20LJJ
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN13%2520LJJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for PN13%20LJJ: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: DC17%20JYO
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC17%2520JYO%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for DC17%20JYO: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: DEZ%20175
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DEZ%2520175%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for DEZ%20175: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: KS66%20ZSY
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS66%2520ZSY%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for KS66%20ZSY: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: MW12%20RYG
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW12%2520RYG%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for MW12%20RYG: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: SM11%20WBL
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SM11%2520WBL%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for SM11%20WBL: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: YP62%20EVF
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YP62%2520EVF%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for YP62%20EVF: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: YR66%20CZW
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR66%2520CZW%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for YR66%20CZW: 2
2026-03-28 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 022fec73-6288-5b89-858a-5c891710f2d0 with identifier: YR66%20CZW
2026-03-28 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 022fec73-6288-5b89-858a-5c891710f2d0 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 022fec73-6288-5b89-858a-5c891710f2d0 with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 022fec73-6288-5b89-858a-5c891710f2d0, identifier: YR66%20CZW
2026-03-28 11:12:21 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 022fec73-6288-5b89-858a-5c891710f2d0 with identifier: YR66%20CZW
2026-03-28 11:12:21 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 022fec73-6288-5b89-858a-5c891710f2d0 with identifier: YR66%20CZW
2026-03-28 11:12:21 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 022fec73-6288-5b89-858a-5c891710f2d0 with identifier: YR66%20CZW to the API
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:21 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 116,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=YR66%20CZW-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.2L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '022fec73-6288-5b89-858a-5c891710f2d0',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'YR66 CZW',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=YR66%20CZW&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'SEAT',
'model': 'IBIZA',
'odometer': 55435,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2016-01-01',
'seller_name': None,
'title': 'SEAT IBIZA 1.2 TSI 90 SE Hatchback',
'transmission': 'manual',
'trim': 'TSI 90 SE',
'vin': 'VSSZZZ6JZHR030716',
'year': 2016}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR66%2520CZW%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Saving data for YR66%20CZW: {'auction_closing_time': 1774951200.0, 'created_time': 1773908504.653908, 'last_price_update_time': 1774696341.722352}
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='YR66%2520CZW') HTTP/1.1" 204 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: DU11%20KVT
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU11%2520KVT%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for DU11%20KVT: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: KY64%20PXG
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY64%2520PXG%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for KY64%20PXG: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: LN66%20SHZ
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN66%2520SHZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for LN66%20SHZ: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: MA13%20NFL
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA13%2520NFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for MA13%20NFL: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: NJ60%20SXP
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ60%2520SXP%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for NJ60%20SXP: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: SH10%20BVC
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH10%2520BVC%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for SH10%20BVC: 0
2026-03-28 11:12:21 [bca.uk] INFO: Found listing with ID: SJ14%20NOF
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:21 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ14%2520NOF%27 HTTP/1.1" 200 None
2026-03-28 11:12:21 [bca.uk] INFO: Scrape type for SJ14%20NOF: 2
2026-03-28 11:12:21 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 12bee4e7-6696-5574-a6b3-6702bdeda16c with identifier: SJ14%20NOF
2026-03-28 11:12:21 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 12bee4e7-6696-5574-a6b3-6702bdeda16c with scrape type 2
2026-03-28 11:12:21 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 12bee4e7-6696-5574-a6b3-6702bdeda16c with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 12bee4e7-6696-5574-a6b3-6702bdeda16c, identifier: SJ14%20NOF
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 12bee4e7-6696-5574-a6b3-6702bdeda16c with identifier: SJ14%20NOF
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 12bee4e7-6696-5574-a6b3-6702bdeda16c with identifier: SJ14%20NOF
2026-03-28 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 12bee4e7-6696-5574-a6b3-6702bdeda16c with identifier: SJ14%20NOF to the API
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=SJ14%20NOF-GB',
'category': 'Car',
'color': 'white',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.6L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '12bee4e7-6696-5574-a6b3-6702bdeda16c',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'SJ14 NOF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=SJ14%20NOF&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'NISSAN',
'model': 'JUKE',
'odometer': 112876,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'NISSAN JUKE 1.6 N-TEC Hatchback',
'transmission': 'manual',
'trim': 'N-TEC',
'vin': 'SJNFBAF15U6497641',
'year': 2014}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ14%2520NOF%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Saving data for SJ14%20NOF: {'auction_closing_time': 1774951200.0, 'created_time': 1773844245.714606, 'last_price_update_time': 1774696342.319815}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='SJ14%2520NOF') HTTP/1.1" 204 0
2026-03-28 11:12:22 [bca.uk] INFO: Found listing with ID: SJ65%20XUT
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ65%2520XUT%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Scrape type for SJ65%20XUT: 0
2026-03-28 11:12:22 [bca.uk] INFO: Found listing with ID: KJ18%20SXG
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ18%2520SXG%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Scrape type for KJ18%20SXG: 0
2026-03-28 11:12:22 [bca.uk] INFO: Found listing with ID: LJ64%20UMR
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJ64%2520UMR%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Scrape type for LJ64%20UMR: 0
2026-03-28 11:12:22 [bca.uk] INFO: Found listing with ID: LV13%20EXZ
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV13%2520EXZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Scrape type for LV13%20EXZ: 0
2026-03-28 11:12:22 [bca.uk] INFO: Found listing with ID: NA15%20UTV
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA15%2520UTV%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Scrape type for NA15%20UTV: 0
2026-03-28 11:12:22 [bca.uk] INFO: Found listing with ID: OU64%20WOH
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU64%2520WOH%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Scrape type for OU64%20WOH: 2
2026-03-28 11:12:22 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b3e134f3-21a7-52bc-98d8-5d8dfd45f72d with identifier: OU64%20WOH
2026-03-28 11:12:22 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b3e134f3-21a7-52bc-98d8-5d8dfd45f72d with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b3e134f3-21a7-52bc-98d8-5d8dfd45f72d with scrape type 2
2026-03-28 11:12:22 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b3e134f3-21a7-52bc-98d8-5d8dfd45f72d, identifier: OU64%20WOH
2026-03-28 11:12:22 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b3e134f3-21a7-52bc-98d8-5d8dfd45f72d with identifier: OU64%20WOH
2026-03-28 11:12:22 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b3e134f3-21a7-52bc-98d8-5d8dfd45f72d with identifier: OU64%20WOH
2026-03-28 11:12:22 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: b3e134f3-21a7-52bc-98d8-5d8dfd45f72d with identifier: OU64%20WOH to the API
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:22 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=24&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 95,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=OU64%20WOH-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': 'b3e134f3-21a7-52bc-98d8-5d8dfd45f72d',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'OU64 WOH',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=OU64%20WOH&vehicleType=*',
'listing': 'auction',
'location': 'Bedford',
'make': 'CITROEN',
'model': 'C1',
'odometer': 30652,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2014-01-01',
'seller_name': None,
'title': 'CITROEN C1 1.0 VTI TOUCH Hatchback',
'transmission': 'manual',
'trim': 'VTI TOUCH',
'vin': 'VF7PSCFBBER511243',
'year': 2014}
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:22 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU64%2520WOH%27 HTTP/1.1" 200 None
2026-03-28 11:12:22 [bca.uk] INFO: Saving data for OU64%20WOH: {'auction_closing_time': 1774951200.0, 'created_time': 1773837586.458496, 'last_price_update_time': 1774696342.997552}
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='OU64%2520WOH') HTTP/1.1" 204 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: EK13%20RKJ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK13%2520RKJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for EK13%20RKJ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: EO60%20LVJ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO60%2520LVJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for EO60%20LVJ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: ET15%20LNC
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET15%2520LNC%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for ET15%20LNC: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: PN09%20VVK
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN09%2520VVK%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for PN09%20VVK: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: YJ69%20DTA
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ69%2520DTA%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for YJ69%20DTA: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: AJ73%20DVM
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ73%2520DVM%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for AJ73%20DVM: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SF68%20RVN
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF68%2520RVN%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SF68%20RVN: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SG22%20VOH
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG22%2520VOH%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SG22%20VOH: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SG22%20VPC
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG22%2520VPC%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SG22%20VPC: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: FE18%20XLP
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE18%2520XLP%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for FE18%20XLP: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: BU67%20XKN
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU67%2520XKN%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for BU67%20XKN: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SA21%20LUT
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA21%2520LUT%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SA21%20LUT: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SB15%20HFS
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520HFS%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SB15%20HFS: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SB64%20ARZ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB64%2520ARZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SB64%20ARZ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SB71%20XEU
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB71%2520XEU%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SB71%20XEU: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SC23%20RKV
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC23%2520RKV%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SC23%20RKV: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SG17%20YRD
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG17%2520YRD%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SG17%20YRD: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SH16%20TWD
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH16%2520TWD%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SH16%20TWD: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SJ72%20JEO
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ72%2520JEO%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SJ72%20JEO: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SN22%20OPG
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN22%2520OPG%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SN22%20OPG: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SP72%20PWY
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP72%2520PWY%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SP72%20PWY: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: VK21%20WLP
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK21%2520WLP%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for VK21%20WLP: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: YF19%20FJL
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF19%2520FJL%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for YF19%20FJL: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: YL17%20EWF
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL17%2520EWF%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for YL17%20EWF: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: AJ13%20LKF
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ13%2520LKF%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for AJ13%20LKF: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: LB14%20KBJ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB14%2520KBJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for LB14%20KBJ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: AF23%20ELH
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF23%2520ELH%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for AF23%20ELH: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: AJ72%20GVR
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ72%2520GVR%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for AJ72%20GVR: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: AV73%20UYJ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV73%2520UYJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for AV73%20UYJ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: BG72%20DUH
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG72%2520DUH%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for BG72%20DUH: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: CJ71%20KAA
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ71%2520KAA%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for CJ71%20KAA: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: FV24%20VKM
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV24%2520VKM%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for FV24%20VKM: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: FV71%20XER
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FV71%2520XER%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for FV71%20XER: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: GN23%20XUZ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN23%2520XUZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for GN23%20XUZ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: KN23%20ZSZ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN23%2520ZSZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for KN23%20ZSZ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: KP72%20XUH
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP72%2520XUH%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for KP72%20XUH: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: LL72%20GLZ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL72%2520GLZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for LL72%20GLZ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: LO23%20MLK
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO23%2520MLK%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for LO23%20MLK: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: LR22%20HKP
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR22%2520HKP%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for LR22%20HKP: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: MA23%20LXR
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520LXR%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for MA23%20LXR: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: MA23%20OOJ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA23%2520OOJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for MA23%20OOJ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: MW72%20XOK
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW72%2520XOK%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for MW72%20XOK: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: NG72%20DVV
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG72%2520DVV%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for NG72%20DVV: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: OY22%20XCS
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY22%2520XCS%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for OY22%20XCS: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: RY24%20YBA
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY24%2520YBA%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for RY24%20YBA: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SJ23%20YZX
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ23%2520YZX%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SJ23%20YZX: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: WA25%20UHX
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA25%2520UHX%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for WA25%20UHX: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: WU23%20ESO
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU23%2520ESO%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for WU23%20ESO: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: WX67%20WPZ
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WX67%2520WPZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for WX67%20WPZ: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: AP71%20GFY
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP71%2520GFY%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for AP71%20GFY: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: RJ68%20ECE
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ68%2520ECE%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for RJ68%20ECE: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: WR21%20YPP
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR21%2520YPP%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for WR21%20YPP: 0
2026-03-28 11:12:23 [bca.uk] INFO: Found listing with ID: SN68%20GKV
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:23 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN68%2520GKV%27 HTTP/1.1" 200 None
2026-03-28 11:12:23 [bca.uk] INFO: Scrape type for SN68%20GKV: 0
2026-03-28 11:12:24 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:24 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:24 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded
2026-03-28 11:12:24 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:24 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:24 [bca.uk] INFO: Found listing with ID: BG70%20NZK
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG70%2520NZK%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [bca.uk] INFO: Scrape type for BG70%20NZK: 0
2026-03-28 11:12:24 [bca.uk] INFO: Found listing with ID: FG70%20HJC
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG70%2520HJC%27 HTTP/1.1" 200 None
2026-03-28 11:12:24 [bca.uk] INFO: Scrape type for FG70%20HJC: 0
2026-03-28 11:12:24 [bca.uk] INFO: Found listing with ID: LY74%20OPG
2026-03-28 11:12:24 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LY74%2520OPG%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LY74%20OPG: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: VO70%20KWG
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO70%2520KWG%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for VO70%20KWG: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: WG71%20LHX
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG71%2520LHX%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for WG71%20LHX: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: YD73%20JXJ
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD73%2520JXJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for YD73%20JXJ: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: YL69%20VRJ
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL69%2520VRJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for YL69%20VRJ: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: CP23%20PXJ
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP23%2520PXJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for CP23%20PXJ: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: DP72%20HJG
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP72%2520HJG%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for DP72%20HJG: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LV72%20OEZ
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV72%2520OEZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LV72%20OEZ: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: RJ22%20XKS
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ22%2520XKS%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for RJ22%20XKS: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: RN19%20HSK
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RN19%2520HSK%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for RN19%20HSK: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: RX72%20KTV
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX72%2520KTV%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for RX72%20KTV: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: VE25%20AFN
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE25%2520AFN%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for VE25%20AFN: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: VN25%20RXF
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN25%2520RXF%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for VN25%20RXF: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: VN25%20ZZD
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN25%2520ZZD%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for VN25%20ZZD: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: VN25%20ZZV
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN25%2520ZZV%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for VN25%20ZZV: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: YC25%20WVA
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC25%2520WVA%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for YC25%20WVA: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: AX72%20KBF
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX72%2520KBF%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for AX72%20KBF: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: BT72%20GFG
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT72%2520GFG%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for BT72%20GFG: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: DL73%20KXW
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL73%2520KXW%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for DL73%20KXW: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: DV24%20BYX
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520BYX%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for DV24%20BYX: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: DV24%20CFM
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520CFM%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for DV24%20CFM: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: DV24%20JSU
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV24%2520JSU%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for DV24%20JSU: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: GM23%20LHE
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM23%2520LHE%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for GM23%20LHE: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: GM23%20LHG
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM23%2520LHG%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for GM23%20LHG: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: GV74%20XKX
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV74%2520XKX%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for GV74%20XKX: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: GY24%20TWL
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY24%2520TWL%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for GY24%20TWL: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: KE23%20CUC
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE23%2520CUC%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for KE23%20CUC: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: KE73%20YZH
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE73%2520YZH%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for KE73%20YZH: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: KF73%20AUY
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520AUY%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for KF73%20AUY: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: KF73%20CXE
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF73%2520CXE%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for KF73%20CXE: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: KJ23%20NMA
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ23%2520NMA%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for KJ23%20NMA: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: KK23%20BVW
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KK23%2520BVW%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for KK23%20BVW: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LL74%20DYY
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL74%2520DYY%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LL74%20DYY: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LN24%20PYB
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520PYB%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LN24%20PYB: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LN24%20RHA
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RHA%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LN24%20RHA: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LN24%20RNF
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RNF%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LN24%20RNF: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LN24%20RVF
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LN24%2520RVF%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LN24%20RVF: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LO74%20XZE
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO74%2520XZE%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LO74%20XZE: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LP73%20DKN
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP73%2520DKN%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LP73%20DKN: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: LT22%20VLG
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT22%2520VLG%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for LT22%20VLG: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: MA24%20FLV
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520FLV%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for MA24%20FLV: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: MA24%20FSV
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA24%2520FSV%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for MA24%20FSV: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: ME73%20NHC
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME73%2520NHC%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for ME73%20NHC: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: MJ74%20HDD
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ74%2520HDD%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for MJ74%20HDD: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: MW74%20DFF
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DFF%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for MW74%20DFF: 0
2026-03-28 11:12:25 [bca.uk] INFO: Found listing with ID: MW74%20DLO
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:25 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520DLO%27 HTTP/1.1" 200 None
2026-03-28 11:12:25 [bca.uk] INFO: Scrape type for MW74%20DLO: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: MW74%20NRL
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW74%2520NRL%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for MW74%20NRL: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: RX73%20KSU
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX73%2520KSU%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for RX73%20KSU: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: WM72%20RXO
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WM72%2520RXO%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for WM72%20RXO: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: WO72%20BWL
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO72%2520BWL%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for WO72%20BWL: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: WP74%20CWK
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP74%2520CWK%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for WP74%20CWK: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: WV74%20OCH
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV74%2520OCH%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for WV74%20OCH: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: YF23%20UOA
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF23%2520UOA%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for YF23%20UOA: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: YY73%20XEC
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XEC%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for YY73%20XEC: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: YY73%20XHZ
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XHZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for YY73%20XHZ: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: YY73%20XJD
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY73%2520XJD%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for YY73%20XJD: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: CP18%20SYV
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP18%2520SYV%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for CP18%20SYV: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: KX68%20NDF
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX68%2520NDF%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for KX68%20NDF: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: ML18%20ZLN
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML18%2520ZLN%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for ML18%20ZLN: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: OY18%20CXR
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520CXR%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for OY18%20CXR: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: PX67%20WMY
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX67%2520WMY%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for PX67%20WMY: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: SV14%20XST
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV14%2520XST%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for SV14%20XST: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: SW69%20PGF
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW69%2520PGF%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for SW69%20PGF: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: EO17%20NNT
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO17%2520NNT%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for EO17%20NNT: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: GB67%20HRV
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GB67%2520HRV%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for GB67%20HRV: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: KV68%20XLU
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV68%2520XLU%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for KV68%20XLU: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: LC22%20KRD
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC22%2520KRD%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for LC22%20KRD: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: LC72%20DHL
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC72%2520DHL%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for LC72%20DHL: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: LL70%20FHT
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL70%2520FHT%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for LL70%20FHT: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: LV24%20JUC
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV24%2520JUC%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for LV24%20JUC: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: OE68%20UGJ
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE68%2520UGJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for OE68%20UGJ: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: SE70%20BUP
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE70%2520BUP%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for SE70%20BUP: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: YC17%20ZWS
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC17%2520ZWS%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for YC17%20ZWS: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: BD71%20ZCE
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD71%2520ZCE%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for BD71%20ZCE: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: GD15%20SPU
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD15%2520SPU%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for GD15%20SPU: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: GD17%20BZC
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD17%2520BZC%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for GD17%20BZC: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: KN69%20EOF
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN69%2520EOF%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for KN69%20EOF: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: BV68%20BNK
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV68%2520BNK%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for BV68%20BNK: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: DU25%20CDO
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU25%2520CDO%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for DU25%20CDO: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: CA14%20HKM
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA14%2520HKM%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for CA14%20HKM: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: EA71%20ATN
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA71%2520ATN%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for EA71%20ATN: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: EA73%20HHR
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA73%2520HHR%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for EA73%20HHR: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: EN68%20RVC
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN68%2520RVC%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for EN68%20RVC: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: EX23%20AYH
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX23%2520AYH%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for EX23%20AYH: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: EY72%20LOD
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY72%2520LOD%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for EY72%20LOD: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: HG69%20EAF
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG69%2520EAF%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for HG69%20EAF: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: KC21%20RYZ
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KC21%2520RYZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for KC21%20RYZ: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: KF24%20OBP
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF24%2520OBP%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for KF24%20OBP: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: LS22%20FOV
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS22%2520FOV%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for LS22%20FOV: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: LX22%20NPA
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX22%2520NPA%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for LX22%20NPA: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: MP65%20PHA
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP65%2520PHA%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for MP65%20PHA: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: WP72%20LTT
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP72%2520LTT%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for WP72%20LTT: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: BG74%20HTT
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG74%2520HTT%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for BG74%20HTT: 0
2026-03-28 11:12:26 [bca.uk] INFO: Found listing with ID: AF22%20VPJ
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:26 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF22%2520VPJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:26 [bca.uk] INFO: Scrape type for AF22%20VPJ: 2
2026-03-28 11:12:26 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: f888771b-3a0e-5543-b765-f02ae507d964 with identifier: AF22%20VPJ
2026-03-28 11:12:26 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item f888771b-3a0e-5543-b765-f02ae507d964 with scrape type 2
2026-03-28 11:12:26 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item f888771b-3a0e-5543-b765-f02ae507d964 with scrape type 2
2026-03-28 11:12:27 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: f888771b-3a0e-5543-b765-f02ae507d964, identifier: AF22%20VPJ
2026-03-28 11:12:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:27 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:27 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: f888771b-3a0e-5543-b765-f02ae507d964 with identifier: AF22%20VPJ
2026-03-28 11:12:27 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: f888771b-3a0e-5543-b765-f02ae507d964 with identifier: AF22%20VPJ
2026-03-28 11:12:27 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: f888771b-3a0e-5543-b765-f02ae507d964 with identifier: AF22%20VPJ to the API
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:27 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=25&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 171,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=AF22%20VPJ-GB',
'category': 'Car',
'color': 'bronze',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Diesel',
'id': 'f888771b-3a0e-5543-b765-f02ae507d964',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'AF22 VPJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=AF22%20VPJ&vehicleType=*',
'listing': 'directbuy',
'location': 'Manchester',
'make': 'LAND ROVER',
'model': 'R/R EVOQUE',
'odometer': 46542,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 18000,
'price_includes_vat': False,
'registration_date': '2022-01-01',
'seller_name': None,
'title': 'LAND ROVER R/R EVOQUE 2.0 D200 4WD R-DYNAMIC S Hatchback',
'transmission': 'automatic',
'trim': 'D200 4WD R-DYNAMIC S',
'vin': 'SALZA2AN8PH180567',
'year': 2022}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF22%2520VPJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:27 [bca.uk] INFO: Saving data for AF22%20VPJ: {'auction_closing_time': 1774854000.0, 'created_time': 1774016666.615821, 'last_price_update_time': 1774696347.910771}
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:27 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='AF22%2520VPJ') HTTP/1.1" 204 0
2026-03-28 11:12:28 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:28 [bca.uk] INFO: Found listing with ID: LD21%20WJN
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD21%2520WJN%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [bca.uk] INFO: Scrape type for LD21%20WJN: 0
2026-03-28 11:12:28 [bca.uk] INFO: Found listing with ID: BL72%20XBS
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL72%2520XBS%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [bca.uk] INFO: Scrape type for BL72%20XBS: 0
2026-03-28 11:12:28 [bca.uk] INFO: Found listing with ID: BV22%20KKH
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV22%2520KKH%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [bca.uk] INFO: Scrape type for BV22%20KKH: 0
2026-03-28 11:12:28 [bca.uk] INFO: Found listing with ID: CN22%20XKK
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:28 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CN22%2520XKK%27 HTTP/1.1" 200 None
2026-03-28 11:12:28 [bca.uk] INFO: Scrape type for CN22%20XKK: 0
2026-03-28 11:12:30 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:30 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:30 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded
2026-03-28 11:12:30 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:30 [bca.uk] INFO: Found listing with ID: DY22%20HSD
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY22%2520HSD%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [bca.uk] INFO: Scrape type for DY22%20HSD: 0
2026-03-28 11:12:30 [bca.uk] INFO: Found listing with ID: JL22%20JRL
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JL22%2520JRL%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [bca.uk] INFO: Scrape type for JL22%20JRL: 0
2026-03-28 11:12:30 [bca.uk] INFO: Found listing with ID: NV19%20ZTT
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520ZTT%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [bca.uk] INFO: Scrape type for NV19%20ZTT: 0
2026-03-28 11:12:30 [bca.uk] INFO: Found listing with ID: OE23%20NVT
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE23%2520NVT%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [bca.uk] INFO: Scrape type for OE23%20NVT: 0
2026-03-28 11:12:30 [bca.uk] INFO: Found listing with ID: OW72%20ESG
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OW72%2520ESG%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [bca.uk] INFO: Scrape type for OW72%20ESG: 0
2026-03-28 11:12:30 [bca.uk] INFO: Found listing with ID: PY23%20MYL
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY23%2520MYL%27 HTTP/1.1" 200 None
2026-03-28 11:12:30 [bca.uk] INFO: Scrape type for PY23%20MYL: 2
2026-03-28 11:12:30 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 0f37c483-3992-59bb-b203-fc857863f16a with identifier: PY23%20MYL
2026-03-28 11:12:30 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 0f37c483-3992-59bb-b203-fc857863f16a with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 0f37c483-3992-59bb-b203-fc857863f16a with scrape type 2
2026-03-28 11:12:30 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 0f37c483-3992-59bb-b203-fc857863f16a, identifier: PY23%20MYL
2026-03-28 11:12:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:30 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:30 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 0f37c483-3992-59bb-b203-fc857863f16a with identifier: PY23%20MYL
2026-03-28 11:12:30 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 0f37c483-3992-59bb-b203-fc857863f16a with identifier: PY23%20MYL
2026-03-28 11:12:30 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 0f37c483-3992-59bb-b203-fc857863f16a with identifier: PY23%20MYL to the API
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:30 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 98,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=PY23%20MYL-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '0f37c483-3992-59bb-b203-fc857863f16a',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'PY23 MYL',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=PY23%20MYL&vehicleType=*',
'listing': 'directbuy',
'location': 'Edinburgh',
'make': 'TOYOTA',
'model': 'YARIS',
'odometer': 26895,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 16200,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'TOYOTA YARIS 1.5 HYBRID EXCEL Hatchback',
'transmission': 'automatic',
'trim': 'HYBRID EXCEL',
'vin': 'VNKKBAC320A304785',
'year': 2023}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY23%2520MYL%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [bca.uk] INFO: Saving data for PY23%20MYL: {'auction_closing_time': 1774854000.0, 'created_time': 1774339323.453847, 'last_price_update_time': 1774696351.398454}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='PY23%2520MYL') HTTP/1.1" 204 0
2026-03-28 11:12:31 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:31 [bca.uk] INFO: Found listing with ID: SL72%20LLG
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL72%2520LLG%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [bca.uk] INFO: Scrape type for SL72%20LLG: 0
2026-03-28 11:12:31 [bca.uk] INFO: Found listing with ID: WN69%20OMC
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN69%2520OMC%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [bca.uk] INFO: Scrape type for WN69%20OMC: 0
2026-03-28 11:12:31 [bca.uk] INFO: Found listing with ID: WP71%20XJM
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520XJM%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [bca.uk] INFO: Scrape type for WP71%20XJM: 2
2026-03-28 11:12:31 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: ebb94a9c-c8a5-5937-b0ae-440e3307a036 with identifier: WP71%20XJM
2026-03-28 11:12:31 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item ebb94a9c-c8a5-5937-b0ae-440e3307a036 with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item ebb94a9c-c8a5-5937-b0ae-440e3307a036 with scrape type 2
2026-03-28 11:12:31 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: ebb94a9c-c8a5-5937-b0ae-440e3307a036, identifier: WP71%20XJM
2026-03-28 11:12:31 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: ebb94a9c-c8a5-5937-b0ae-440e3307a036 with identifier: WP71%20XJM
2026-03-28 11:12:31 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: ebb94a9c-c8a5-5937-b0ae-440e3307a036 with identifier: WP71%20XJM
2026-03-28 11:12:31 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: ebb94a9c-c8a5-5937-b0ae-440e3307a036 with identifier: WP71%20XJM to the API
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:31 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': None,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WP71%20XJM-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '0.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Electric',
'id': 'ebb94a9c-c8a5-5937-b0ae-440e3307a036',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'WP71 XJM',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WP71%20XJM&vehicleType=*',
'listing': 'directbuy',
'location': 'Measham',
'make': 'RENAULT',
'model': 'ZOE E-TECH',
'odometer': 21466,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 6800,
'price_includes_vat': False,
'registration_date': '2021-01-01',
'seller_name': None,
'title': 'RENAULT ZOE E-TECH 50KWH 110 ICONIC (50KW) Hatchback',
'transmission': 'automatic',
'trim': '50KWH 110 ICONIC (50KW)',
'vin': 'VF1AG000X68514866',
'year': 2021}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520XJM%27 HTTP/1.1" 200 None
2026-03-28 11:12:31 [bca.uk] INFO: Saving data for WP71%20XJM: {'auction_closing_time': 1774854000.0, 'created_time': 1774339322.155273, 'last_price_update_time': 1774696351.953012}
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:31 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WP71%2520XJM') HTTP/1.1" 204 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: WR72%20NFL
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR72%2520NFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for WR72%20NFL: 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: WV23%20VRE
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV23%2520VRE%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for WV23%20VRE: 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: WV71%20SYU
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV71%2520SYU%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for WV71%20SYU: 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: YR22%20XOS
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YR22%2520XOS%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for YR22%20XOS: 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: CE73%20GNO
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE73%2520GNO%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for CE73%20GNO: 2
2026-03-28 11:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 66491506-46bf-544c-8b06-27c194f14a45 with identifier: CE73%20GNO
2026-03-28 11:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 66491506-46bf-544c-8b06-27c194f14a45 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 66491506-46bf-544c-8b06-27c194f14a45 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 66491506-46bf-544c-8b06-27c194f14a45, identifier: CE73%20GNO
2026-03-28 11:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 66491506-46bf-544c-8b06-27c194f14a45 with identifier: CE73%20GNO
2026-03-28 11:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 66491506-46bf-544c-8b06-27c194f14a45 with identifier: CE73%20GNO
2026-03-28 11:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 66491506-46bf-544c-8b06-27c194f14a45 with identifier: CE73%20GNO to the API
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:32 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 138,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=CE73%20GNO-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol',
'id': '66491506-46bf-544c-8b06-27c194f14a45',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'CE73 GNO',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=CE73%20GNO&vehicleType=*',
'listing': 'directbuy',
'location': 'Blackbushe',
'make': 'VOLKSWAGEN',
'model': 'T-ROC',
'odometer': 22900,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 16300,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'VOLKSWAGEN T-ROC 1.5 TSI 150 LIFE DSG Hatchback',
'transmission': 'automatic',
'trim': 'TSI 150 LIFE DSG',
'vin': 'WVGZZZA1ZPV739188',
'year': 2023}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE73%2520GNO%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Saving data for CE73%20GNO: {'auction_closing_time': 1774854000.0, 'created_time': 1774339338.827496, 'last_price_update_time': 1774696352.592103}
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='CE73%2520GNO') HTTP/1.1" 204 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: HJ72%20LSK
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ72%2520LSK%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for HJ72%20LSK: 0
2026-03-28 11:12:32 [bca.uk] INFO: Found listing with ID: HJ73%20NVZ
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ73%2520NVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:32 [bca.uk] INFO: Scrape type for HJ73%20NVZ: 2
2026-03-28 11:12:32 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 8c02a768-7471-5bce-a979-4dedc6f2d5d4 with identifier: HJ73%20NVZ
2026-03-28 11:12:32 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 8c02a768-7471-5bce-a979-4dedc6f2d5d4 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 8c02a768-7471-5bce-a979-4dedc6f2d5d4 with scrape type 2
2026-03-28 11:12:32 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 8c02a768-7471-5bce-a979-4dedc6f2d5d4, identifier: HJ73%20NVZ
2026-03-28 11:12:32 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 8c02a768-7471-5bce-a979-4dedc6f2d5d4 with identifier: HJ73%20NVZ
2026-03-28 11:12:32 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 8c02a768-7471-5bce-a979-4dedc6f2d5d4 with identifier: HJ73%20NVZ
2026-03-28 11:12:32 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 8c02a768-7471-5bce-a979-4dedc6f2d5d4 with identifier: HJ73%20NVZ to the API
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:32 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 143,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=HJ73%20NVZ-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol',
'id': '8c02a768-7471-5bce-a979-4dedc6f2d5d4',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'HJ73 NVZ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=HJ73%20NVZ&vehicleType=*',
'listing': 'directbuy',
'location': 'Bedford',
'make': 'AUDI',
'model': 'A5 SPORTBACK',
'odometer': 21886,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 21000,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'AUDI A5 SPORTBACK 2.0 35 TFSI SPORT S-T Hatchback',
'transmission': 'automatic',
'trim': '35 TFSI SPORT S-T',
'vin': 'WAUZZZF51PA068393',
'year': 2023}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ73%2520NVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Saving data for HJ73%20NVZ: {'auction_closing_time': 1774854000.0, 'created_time': 1774339283.317317, 'last_price_update_time': 1774696353.092688}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='HJ73%2520NVZ') HTTP/1.1" 204 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: KN22%20FCJ
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN22%2520FCJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for KN22%20FCJ: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: SL69%20ZSR
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL69%2520ZSR%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for SL69%20ZSR: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: VE69%20TZS
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE69%2520TZS%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for VE69%20TZS: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: WR72%20NFF
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR72%2520NFF%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for WR72%20NFF: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: YJ23%20GJR
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YJ23%2520GJR%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for YJ23%20GJR: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: YL22%20LFZ
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL22%2520LFZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for YL22%20LFZ: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: EO72%20JXN
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO72%2520JXN%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for EO72%20JXN: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: LV75%20ODE
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV75%2520ODE%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for LV75%20ODE: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: SN71%20LRF
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN71%2520LRF%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for SN71%20LRF: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: SO21%20GWZ
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SO21%2520GWZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for SO21%20GWZ: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: YA71%20PSU
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YA71%2520PSU%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for YA71%20PSU: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: BP72%20FJN
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP72%2520FJN%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for BP72%20FJN: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: BT72%20MWN
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT72%2520MWN%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for BT72%20MWN: 2
2026-03-28 11:12:33 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 322d86d0-16dd-5f29-8ed4-3407abbb2129 with identifier: BT72%20MWN
2026-03-28 11:12:33 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 322d86d0-16dd-5f29-8ed4-3407abbb2129 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 322d86d0-16dd-5f29-8ed4-3407abbb2129 with scrape type 2
2026-03-28 11:12:33 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 322d86d0-16dd-5f29-8ed4-3407abbb2129, identifier: BT72%20MWN
2026-03-28 11:12:33 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 322d86d0-16dd-5f29-8ed4-3407abbb2129 with identifier: BT72%20MWN
2026-03-28 11:12:33 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 322d86d0-16dd-5f29-8ed4-3407abbb2129 with identifier: BT72%20MWN
2026-03-28 11:12:33 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 322d86d0-16dd-5f29-8ed4-3407abbb2129 with identifier: BT72%20MWN to the API
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:33 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=26&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 36,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=BT72%20MWN-GB',
'category': 'Car',
'color': 'blue',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.5L',
'expiration_date': '2026-03-30T07:00:00Z',
'fuel_type': 'Petrol/Electric',
'id': '322d86d0-16dd-5f29-8ed4-3407abbb2129',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': True,
'is_vat_included': False,
'license_plate': 'BT72 MWN',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=BT72%20MWN&vehicleType=*',
'listing': 'directbuy',
'location': 'Nottingham',
'make': 'LAND ROVER',
'model': 'DISCOVERY SPORT',
'odometer': 31997,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 21500,
'price_includes_vat': False,
'registration_date': '2023-01-01',
'seller_name': None,
'title': 'LAND ROVER DISCOVERY SPORT 1.5 P300E URBAN ED.(5ST) StationWagon',
'transmission': 'automatic',
'trim': 'P300E URBAN ED.(5ST)',
'vin': 'SALCA2AT8PH325613',
'year': 2023}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT72%2520MWN%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Saving data for BT72%20MWN: {'auction_closing_time': 1774854000.0, 'created_time': 1773929212.133284, 'last_price_update_time': 1774696353.790865}
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='BT72%2520MWN') HTTP/1.1" 204 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: WA19%20NEN
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA19%2520NEN%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for WA19%20NEN: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: YH14%20LRL
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH14%2520LRL%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for YH14%20LRL: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: BU22%20TFA
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:33 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU22%2520TFA%27 HTTP/1.1" 200 None
2026-03-28 11:12:33 [bca.uk] INFO: Scrape type for BU22%20TFA: 0
2026-03-28 11:12:33 [bca.uk] INFO: Found listing with ID: FN24%20SBO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN24%2520SBO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for FN24%20SBO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: GV72%20KDZ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GV72%2520KDZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for GV72%20KDZ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: HV22%20ZSJ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV22%2520ZSJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for HV22%20ZSJ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: HV72%20WUX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV72%2520WUX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for HV72%20WUX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: LR21%20YCX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR21%2520YCX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for LR21%20YCX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: MF23%20CZG
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF23%2520CZG%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for MF23%20CZG: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: OV23%20CWD
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV23%2520CWD%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for OV23%20CWD: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: RA73%20DWD
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RA73%2520DWD%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for RA73%20DWD: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: RY73%20CVE
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY73%2520CVE%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for RY73%20CVE: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: YG22%20UMR
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG22%2520UMR%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for YG22%20UMR: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: YM74%20WVO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YM74%2520WVO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for YM74%20WVO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: ME21%20CKL
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ME21%2520CKL%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for ME21%20CKL: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: RE22%20NXV
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE22%2520NXV%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for RE22%20NXV: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: KR71%20ZNS
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR71%2520ZNS%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for KR71%20ZNS: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: YF66%20KXE
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF66%2520KXE%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for YF66%20KXE: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: BN20%20EGF
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN20%2520EGF%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for BN20%20EGF: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: PK15%20OTH
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK15%2520OTH%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for PK15%20OTH: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: PJ10%20BZK
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ10%2520BZK%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for PJ10%20BZK: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: RF18%20AEK
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF18%2520AEK%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for RF18%20AEK: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: SN61%20GDO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN61%2520GDO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for SN61%20GDO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: WP72%20FXD
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP72%2520FXD%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for WP72%20FXD: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: WA11%20CDO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA11%2520CDO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for WA11%20CDO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: ET21%20SCO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET21%2520SCO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for ET21%20SCO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: LO21%20XVZ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO21%2520XVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for LO21%20XVZ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: BJ68%20NTY
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ68%2520NTY%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for BJ68%20NTY: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: BV23%20GXM
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV23%2520GXM%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for BV23%20GXM: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: FX22%20TVJ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX22%2520TVJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for FX22%20TVJ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: LC68%20DRX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC68%2520DRX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for LC68%20DRX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: RK70%20GYB
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RK70%2520GYB%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for RK70%20GYB: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: RV22%20XFF
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV22%2520XFF%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for RV22%20XFF: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: MK68%20BWN
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK68%2520BWN%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for MK68%20BWN: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: OY18%20OXG
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY18%2520OXG%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for OY18%20OXG: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: PK22%20WPW
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK22%2520WPW%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for PK22%20WPW: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: YT22%20AHN
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT22%2520AHN%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for YT22%20AHN: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: KT18%20NNJ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KT18%2520NNJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for KT18%20NNJ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: SW16%20LHX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW16%2520LHX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for SW16%20LHX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: BC22%20HLN
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BC22%2520HLN%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for BC22%20HLN: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: C12%20OLL
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27C12%2520OLL%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for C12%20OLL: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: DY68%20VKP
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY68%2520VKP%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for DY68%20VKP: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: NA22%20COJ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA22%2520COJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for NA22%20COJ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: NX69%20MFO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX69%2520MFO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for NX69%20MFO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: SG71%20XJD
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG71%2520XJD%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for SG71%20XJD: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: SW22%20JBO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW22%2520JBO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for SW22%20JBO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: KS20%20GNF
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS20%2520GNF%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for KS20%20GNF: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: KV68%20FFL
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV68%2520FFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for KV68%20FFL: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: MA22%20UZX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA22%2520UZX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for MA22%20UZX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: OV69%20ZYX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OV69%2520ZYX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for OV69%20ZYX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: YF72%20SCZ
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF72%2520SCZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for YF72%20SCZ: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: LM22%20ZTO
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM22%2520ZTO%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for LM22%20ZTO: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: KS21%20FGU
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS21%2520FGU%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for KS21%20FGU: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: LF68%20HUV
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF68%2520HUV%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for LF68%20HUV: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: KW18%20DWX
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW18%2520DWX%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for KW18%20DWX: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: LR19%20NCU
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:34 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR19%2520NCU%27 HTTP/1.1" 200 None
2026-03-28 11:12:34 [bca.uk] INFO: Scrape type for LR19%20NCU: 0
2026-03-28 11:12:34 [bca.uk] INFO: Found listing with ID: WF70%20FSN
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF70%2520FSN%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for WF70%20FSN: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: DK20%20WOA
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK20%2520WOA%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for DK20%20WOA: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: ET19%20WKG
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ET19%2520WKG%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for ET19%20WKG: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: TFZ%20699
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27TFZ%2520699%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for TFZ%20699: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: FP67%20UMG
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520UMG%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for FP67%20UMG: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: FE66%20AWZ
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE66%2520AWZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for FE66%20AWZ: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: DY66%20WHN
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DY66%2520WHN%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for DY66%20WHN: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: AJ14%20YHZ
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ14%2520YHZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for AJ14%20YHZ: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: AX15%20DXW
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX15%2520DXW%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for AX15%20DXW: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: FY69%20XBU
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY69%2520XBU%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for FY69%20XBU: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: PK15%20OCD
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK15%2520OCD%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for PK15%20OCD: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: DN71%20VHK
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN71%2520VHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for DN71%20VHK: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: SB12%20OSV
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB12%2520OSV%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for SB12%20OSV: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: GD14%20WOR
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD14%2520WOR%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for GD14%20WOR: 0
2026-03-28 11:12:35 [bca.uk] INFO: Found listing with ID: HJ67%20FFE
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:35 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ67%2520FFE%27 HTTP/1.1" 200 None
2026-03-28 11:12:35 [bca.uk] INFO: Scrape type for HJ67%20FFE: 0
2026-03-28 11:12:37 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:37 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:37 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded
2026-03-28 11:12:37 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:37 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: HK19%20RSV
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK19%2520RSV%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for HK19%20RSV: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: EX12%20HXL
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EX12%2520HXL%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for EX12%20HXL: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: GK19%20NSO
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GK19%2520NSO%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for GK19%20NSO: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: WD70%20HZX
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD70%2520HZX%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for WD70%20HZX: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: FL68%20LDZ
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520LDZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for FL68%20LDZ: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: EK71%20XHH
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK71%2520XHH%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for EK71%20XHH: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: LK71%20MTX
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK71%2520MTX%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for LK71%20MTX: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: EF16%20YTX
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF16%2520YTX%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for EF16%20YTX: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: BF71%20NFL
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF71%2520NFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for BF71%20NFL: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: CJ19%20WVD
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CJ19%2520WVD%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for CJ19%20WVD: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: KM25%20GXC
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM25%2520GXC%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for KM25%20GXC: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: YC18%20JNL
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC18%2520JNL%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for YC18%20JNL: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: DO19%20LPJ
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DO19%2520LPJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for DO19%20LPJ: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: BN16%20KWU
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN16%2520KWU%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for BN16%20KWU: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: EY19%20WCL
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY19%2520WCL%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for EY19%20WCL: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: NL64%20UCU
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL64%2520UCU%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for NL64%20UCU: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: FB19%20XFJ
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FB19%2520XFJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for FB19%20XFJ: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: DK24%20YOC
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK24%2520YOC%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for DK24%20YOC: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: EJ63%20XXE
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EJ63%2520XXE%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for EJ63%20XXE: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: KF19%20XKV
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KF19%2520XKV%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for KF19%20XKV: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: YW18%20ETK
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW18%2520ETK%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for YW18%20ETK: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: BP63%20NVY
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP63%2520NVY%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for BP63%20NVY: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: FG19%20YWD
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG19%2520YWD%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for FG19%20YWD: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: LF19%20FON
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF19%2520FON%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for LF19%20FON: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: LL70%20FOU
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL70%2520FOU%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for LL70%20FOU: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: YD69%20XES
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD69%2520XES%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for YD69%20XES: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: D10%20LKE
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27D10%2520LKE%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for D10%20LKE: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: DGZ%206301
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DGZ%25206301%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for DGZ%206301: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: GX69%20UTS
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX69%2520UTS%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for GX69%20UTS: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: KY67%20GGX
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KY67%2520GGX%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for KY67%20GGX: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: LT68%20DYO
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT68%2520DYO%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for LT68%20DYO: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: PK16%20SFV
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520SFV%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for PK16%20SFV: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: YL70%20FHK
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL70%2520FHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:37 [bca.uk] INFO: Scrape type for YL70%20FHK: 0
2026-03-28 11:12:37 [bca.uk] INFO: Found listing with ID: GJ64%20VAM
2026-03-28 11:12:37 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520VAM%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for GJ64%20VAM: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: GY20%20BYH
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GY20%2520BYH%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for GY20%20BYH: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: OY67%20YSO
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY67%2520YSO%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for OY67%20YSO: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: RE70%20NBM
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE70%2520NBM%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for RE70%20NBM: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NX18%20FWO
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX18%2520FWO%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NX18%20FWO: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NU17%20KLJ
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU17%2520KLJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NU17%20KLJ: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: DK11%20TWU
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DK11%2520TWU%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for DK11%20TWU: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: YC12%20XPH
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YC12%2520XPH%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for YC12%20XPH: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: DA71%20OZO
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA71%2520OZO%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for DA71%20OZO: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LM21%20ATZ
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM21%2520ATZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LM21%20ATZ: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LV09%20KGA
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV09%2520KGA%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LV09%20KGA: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: MP19%20BYW
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MP19%2520BYW%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for MP19%20BYW: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: MC65%20RYZ
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC65%2520RYZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for MC65%20RYZ: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: MK12%20UZT
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK12%2520UZT%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for MK12%20UZT: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NC21%20XCP
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC21%2520XCP%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NC21%20XCP: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NG71%20LSV
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NG71%2520LSV%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NG71%20LSV: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NL67%20WRR
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NL67%2520WRR%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NL67%20WRR: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: SV18%20YJF
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV18%2520YJF%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for SV18%20YJF: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WN08%20CUA
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN08%2520CUA%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WN08%20CUA: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: YS65%20LXE
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS65%2520LXE%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for YS65%20LXE: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: AF71%20XKX
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF71%2520XKX%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for AF71%20XKX: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: GJ17%20EKE
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ17%2520EKE%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for GJ17%20EKE: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: GJ67%20KLX
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ67%2520KLX%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for GJ67%20KLX: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LA18%20AET
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA18%2520AET%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LA18%20AET: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LV59%20FNP
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV59%2520FNP%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LV59%20FNP: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WG16%20MYO
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG16%2520MYO%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WG16%20MYO: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: HJ53%20UMZ
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ53%2520UMZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for HJ53%20UMZ: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: KW12%20BNK
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW12%2520BNK%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for KW12%20BNK: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: DL13%20RHV
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL13%2520RHV%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for DL13%20RHV: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: DN68%20GZS
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN68%2520GZS%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for DN68%20GZS: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: DP68%20HHK
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DP68%2520HHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for DP68%20HHK: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: GF14%20ONR
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF14%2520ONR%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for GF14%20ONR: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LP14%20USW
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP14%2520USW%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LP14%20USW: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LR18%20BTV
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520BTV%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LR18%20BTV: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: MK61%20URX
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK61%2520URX%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for MK61%20URX: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: VN69%20NTA
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN69%2520NTA%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for VN69%20NTA: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WN69%20UXG
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN69%2520UXG%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WN69%20UXG: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: X367%20CLB
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27X367%2520CLB%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for X367%20CLB: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: YS18%20UXW
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520UXW%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for YS18%20UXW: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: YT13%20XDJ
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT13%2520XDJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for YT13%20XDJ: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: CX59%20PFA
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX59%2520PFA%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for CX59%20PFA: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LO17%20TMV
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LO17%2520TMV%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LO17%20TMV: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: KU12%20YOR
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KU12%2520YOR%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for KU12%20YOR: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WA68%20CZR
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WA68%2520CZR%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WA68%20CZR: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: SK13%20EOT
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK13%2520EOT%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for SK13%20EOT: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: LA18%20YHN
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LA18%2520YHN%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for LA18%20YHN: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: YY61%20AUF
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY61%2520AUF%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for YY61%20AUF: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NK11%20HXL
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NK11%2520HXL%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NK11%20HXL: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: NA53%20FUP
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA53%2520FUP%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for NA53%20FUP: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WF18%20OXJ
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF18%2520OXJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WF18%20OXJ: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WJ22%20JVP
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ22%2520JVP%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WJ22%20JVP: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WK12%20UZF
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK12%2520UZF%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WK12%20UZF: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: WK72%20LWL
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK72%2520LWL%27 HTTP/1.1" 200 None
2026-03-28 11:12:38 [bca.uk] INFO: Scrape type for WK72%20LWL: 0
2026-03-28 11:12:38 [bca.uk] INFO: Found listing with ID: Y886%20UBK
2026-03-28 11:12:38 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y886%2520UBK%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for Y886%20UBK: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: HY19%20NVK
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY19%2520NVK%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for HY19%20NVK: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: KN71%20ZFC
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KN71%2520ZFC%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for KN71%20ZFC: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: KR20%20WEC
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR20%2520WEC%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for KR20%20WEC: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: MK69%20KRX
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK69%2520KRX%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for MK69%20KRX: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: RO10%20RBV
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO10%2520RBV%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for RO10%20RBV: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: RX66%20ZCZ
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX66%2520ZCZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for RX66%20ZCZ: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: SA68%20YKR
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520YKR%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for SA68%20YKR: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: SK67%20KUB
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520KUB%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for SK67%20KUB: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: SN66%20PGE
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN66%2520PGE%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for SN66%20PGE: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: VO20%20ZZM
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO20%2520ZZM%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for VO20%20ZZM: 0
2026-03-28 11:12:39 [bca.uk] INFO: Found listing with ID: WD17%20LOJ
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD17%2520LOJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:39 [bca.uk] INFO: Scrape type for WD17%20LOJ: 2
2026-03-28 11:12:39 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 005152aa-ade1-5139-9423-ce8724551a3e with identifier: WD17%20LOJ
2026-03-28 11:12:39 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 005152aa-ade1-5139-9423-ce8724551a3e with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 005152aa-ade1-5139-9423-ce8724551a3e with scrape type 2
2026-03-28 11:12:39 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 005152aa-ade1-5139-9423-ce8724551a3e, identifier: WD17%20LOJ
2026-03-28 11:12:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:39 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:39 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 005152aa-ade1-5139-9423-ce8724551a3e with identifier: WD17%20LOJ
2026-03-28 11:12:39 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 005152aa-ade1-5139-9423-ce8724551a3e with identifier: WD17%20LOJ
2026-03-28 11:12:39 [crawlers.pipelines.post_to_api] INFO: Spider: bca.uk, Posting item: 005152aa-ade1-5139-9423-ce8724551a3e with identifier: WD17%20LOJ to the API
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: Starting new HTTPS connection (1): api.app.infinit.cc:443
2026-03-28 11:12:39 [urllib3.connectionpool] DEBUG: https://api.app.infinit.cc:443 "POST /api/command/Alx.Cars.Contracts.Internal.Sourcing.AddListing HTTP/1.1" 200 None
2026-03-28 11:12:40 [scrapy.core.scraper] DEBUG: Scraped from <200 https://www.bca.co.uk/api/search?q=&pageSize=100&page=27&sort=MostRecentlyAdded>
{'auction_title': '',
'c_o_2_emission_value': 101,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=WD17%20LOJ-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 5,
'engine': '1.0L',
'expiration_date': '2026-03-31T10:00:00Z',
'fuel_type': 'Petrol',
'id': '005152aa-ade1-5139-9423-ce8724551a3e',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'WD17 LOJ',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=WD17%20LOJ&vehicleType=*',
'listing': 'auction',
'location': 'Bristol',
'make': 'KIA',
'model': 'PICANTO',
'odometer': 46475,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'KIA PICANTO 1.0 2 Hatchback',
'transmission': 'manual',
'trim': '2',
'vin': 'KNAB3511LJT055889',
'year': 2017}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WD17%2520LOJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [bca.uk] INFO: Saving data for WD17%20LOJ: {'auction_closing_time': 1774951200.0, 'created_time': 1774512168.933749, 'last_price_update_time': 1774696360.076741}
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='WD17%2520LOJ') HTTP/1.1" 204 0
2026-03-28 11:12:40 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:40 [bca.uk] INFO: Found listing with ID: AY70%20UXZ
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AY70%2520UXZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [bca.uk] INFO: Scrape type for AY70%20UXZ: 0
2026-03-28 11:12:40 [bca.uk] INFO: Found listing with ID: CA22%20ORW
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:40 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA22%2520ORW%27 HTTP/1.1" 200 None
2026-03-28 11:12:40 [bca.uk] INFO: Scrape type for CA22%20ORW: 0
2026-03-28 11:12:42 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=28&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:42 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:42 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded
2026-03-28 11:12:42 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:42 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: CP22%20DPV
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CP22%2520DPV%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for CP22%20DPV: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: CV69%20KLS
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV69%2520KLS%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for CV69%20KLS: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: DL64%20PUA
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL64%2520PUA%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for DL64%20PUA: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: EO10%20ZHY
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EO10%2520ZHY%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for EO10%20ZHY: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: HX17%20TCV
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HX17%2520TCV%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for HX17%20TCV: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: GF09%20WVJ
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF09%2520WVJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for GF09%20WVJ: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: MV12%20NVP
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV12%2520NVP%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for MV12%20NVP: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: Y467%20UKE
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27Y467%2520UKE%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for Y467%20UKE: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: RIL%206309
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RIL%25206309%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for RIL%206309: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KM23%20LCL
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM23%2520LCL%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KM23%20LCL: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KS73%20SSO
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS73%2520SSO%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KS73%20SSO: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: MW24%20YOG
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW24%2520YOG%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for MW24%20YOG: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: NC71%20AYS
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NC71%2520AYS%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for NC71%20AYS: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: FT13%20HXR
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FT13%2520HXR%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for FT13%20HXR: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KS23%20HYZ
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KS23%2520HYZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KS23%20HYZ: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KW23%20CMZ
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW23%2520CMZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KW23%20CMZ: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KW73%20YLM
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YLM%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KW73%20YLM: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KW73%20YVM
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YVM%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KW73%20YVM: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: OY17%20VGJ
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY17%2520VGJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for OY17%20VGJ: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: FG21%20ZHO
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG21%2520ZHO%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for FG21%20ZHO: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: YN68%20HMH
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YN68%2520HMH%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for YN68%20HMH: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: GD73%20KHH
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GD73%2520KHH%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for GD73%20KHH: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: GL73%20XFX
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL73%2520XFX%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for GL73%20XFX: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: CX13%20HLM
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX13%2520HLM%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for CX13%20HLM: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KW73%20TVV
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520TVV%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KW73%20TVV: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KW73%20YUH
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YUH%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KW73%20YUH: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: MW73%20GFU
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW73%2520GFU%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for MW73%20GFU: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: BP65%20KMU
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BP65%2520KMU%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for BP65%20KMU: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KW23%20CUO
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW23%2520CUO%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KW23%20CUO: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: GJ73%20VUE
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ73%2520VUE%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for GJ73%20VUE: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: GF15%20WDN
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF15%2520WDN%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for GF15%20WDN: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: MV63%20YNE
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV63%2520YNE%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for MV63%20YNE: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: YH73%20KXU
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH73%2520KXU%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for YH73%20KXU: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: HV18%20VJN
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV18%2520VJN%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for HV18%20VJN: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: YE22%20DYJ
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE22%2520DYJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for YE22%20DYJ: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: GU10%20OWY
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU10%2520OWY%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for GU10%20OWY: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: VX14%20FDO
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VX14%2520FDO%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for VX14%20FDO: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: BF18%20WVY
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520WVY%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for BF18%20WVY: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: DU16%20BNV
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU16%2520BNV%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for DU16%20BNV: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: DU19%20LXP
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU19%2520LXP%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for DU19%20LXP: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: FE13%20BSX
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE13%2520BSX%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for FE13%20BSX: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: FG10%20DWA
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FG10%2520DWA%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for FG10%20DWA: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: FP64%20XAG
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP64%2520XAG%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for FP64%20XAG: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: FX13%20ZBR
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX13%2520ZBR%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for FX13%20ZBR: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: KP18%20FLZ
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP18%2520FLZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for KP18%20FLZ: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: LM65%20HYX
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM65%2520HYX%27 HTTP/1.1" 200 None
2026-03-28 11:12:42 [bca.uk] INFO: Scrape type for LM65%20HYX: 0
2026-03-28 11:12:42 [bca.uk] INFO: Found listing with ID: MM13%20DND
2026-03-28 11:12:42 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM13%2520DND%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for MM13%20DND: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: PK66%20BWX
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK66%2520BWX%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for PK66%20BWX: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WR18%20FBU
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR18%2520FBU%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WR18%20FBU: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: YS13%20UYC
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS13%2520UYC%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for YS13%20UYC: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: YY56%20EDK
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YY56%2520EDK%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for YY56%20EDK: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WR66%20CUK
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR66%2520CUK%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WR66%20CUK: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: YL57%20BXX
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL57%2520BXX%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for YL57%20BXX: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: SP12%20ZFL
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SP12%2520ZFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for SP12%20ZFL: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GJ73%20VLX
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ73%2520VLX%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GJ73%20VLX: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: KW73%20YUN
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KW73%2520YUN%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for KW73%20YUN: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: L44%20KDN
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27L44%2520KDN%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for L44%20KDN: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: FP61%20YTJ
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP61%2520YTJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for FP61%20YTJ: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: MC19%20FDG
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MC19%2520FDG%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for MC19%20FDG: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: RL05%20YPN
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RL05%2520YPN%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for RL05%20YPN: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: FP67%20ORG
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FP67%2520ORG%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for FP67%20ORG: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: OE08%20ZZO
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE08%2520ZZO%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for OE08%20ZZO: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: YG65%20YRR
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG65%2520YRR%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for YG65%20YRR: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: EK67%20XXS
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EK67%2520XXS%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for EK67%20XXS: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GJ68%20AFV
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ68%2520AFV%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GJ68%20AFV: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GM69%20BGK
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM69%2520BGK%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GM69%20BGK: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: HY13%20XUR
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HY13%2520XUR%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for HY13%20XUR: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: MJ17%20DZY
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ17%2520DZY%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for MJ17%20DZY: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: OE66%20NBM
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE66%2520NBM%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for OE66%20NBM: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: OE71%20BYH
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OE71%2520BYH%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for OE71%20BYH: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: RO22%20GYW
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO22%2520GYW%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for RO22%20GYW: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WJ62%20LRX
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ62%2520LRX%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WJ62%20LRX: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WJ70%20VKB
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WJ70%2520VKB%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WJ70%20VKB: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WN66%20UHK
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN66%2520UHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WN66%20UHK: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: DL70%20HFP
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL70%2520HFP%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for DL70%20HFP: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GJ64%20YHL
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GJ64%2520YHL%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GJ64%20YHL: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: KP65%20LLC
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520LLC%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for KP65%20LLC: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: DV21%20LWE
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV21%2520LWE%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for DV21%20LWE: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: EY08%20CFJ
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY08%2520CFJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for EY08%20CFJ: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: FN17%20YVC
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FN17%2520YVC%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for FN17%20YVC: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: HJ64%20UZB
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ64%2520UZB%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for HJ64%20UZB: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: MH16%20BXV
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MH16%2520BXV%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for MH16%20BXV: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: MJ17%20VKW
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MJ17%2520VKW%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for MJ17%20VKW: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: SC16%20NGN
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520NGN%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for SC16%20NGN: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WN13%20MHL
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN13%2520MHL%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WN13%20MHL: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: DU17%20AXN
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU17%2520AXN%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for DU17%20AXN: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: SC61%20BYP
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC61%2520BYP%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for SC61%20BYP: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: RO09%20UJK
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RO09%2520UJK%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for RO09%20UJK: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: KV66%20XDL
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV66%2520XDL%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for KV66%20XDL: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: WR65%20XTS
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR65%2520XTS%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for WR65%20XTS: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: HV58%20LRN
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV58%2520LRN%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for HV58%20LRN: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GN63%20FFY
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GN63%2520FFY%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GN63%20FFY: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GC19%20TZA
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GC19%2520TZA%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GC19%20TZA: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: SD68%20NLT
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD68%2520NLT%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for SD68%20NLT: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: RX65%20VOJ
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RX65%2520VOJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for RX65%20VOJ: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: AF66%20BUH
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF66%2520BUH%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for AF66%20BUH: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: BL64%20YTM
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL64%2520YTM%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for BL64%20YTM: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: EN16%20KRD
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EN16%2520KRD%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for EN16%20KRD: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: OU73%20MMX
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU73%2520MMX%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for OU73%20MMX: 0
2026-03-28 11:12:43 [bca.uk] INFO: Found listing with ID: GF12%20OAY
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:43 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF12%2520OAY%27 HTTP/1.1" 200 None
2026-03-28 11:12:43 [bca.uk] INFO: Scrape type for GF12%20OAY: 0
2026-03-28 11:12:43 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:43 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:43 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:48 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=29&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:48 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:48 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded
2026-03-28 11:12:48 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:48 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: YB62%20NUW
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YB62%2520NUW%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for YB62%20NUW: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: DV15%20HHN
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV15%2520HHN%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for DV15%20HHN: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: VE13%20GBF
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VE13%2520GBF%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for VE13%20GBF: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: RF56%20WZG
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RF56%2520WZG%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for RF56%20WZG: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: HV65%20GSU
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HV65%2520GSU%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for HV65%20GSU: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: LD66%20BVN
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LD66%2520BVN%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for LD66%20BVN: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: BJ62%20USG
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ62%2520USG%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for BJ62%20USG: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: YW19%20FPU
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YW19%2520FPU%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for YW19%20FPU: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: AU69%20VFL
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AU69%2520VFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:48 [bca.uk] INFO: Scrape type for AU69%20VFL: 0
2026-03-28 11:12:48 [bca.uk] INFO: Found listing with ID: PY10%20FWJ
2026-03-28 11:12:48 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY10%2520FWJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for PY10%20FWJ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: WN14%20ZYL
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WN14%2520ZYL%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for WN14%20ZYL: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: SB66%20OSX
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB66%2520OSX%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for SB66%20OSX: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: LS21%20MME
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS21%2520MME%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for LS21%20MME: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: WF17%20ZXA
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF17%2520ZXA%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for WF17%20ZXA: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: SE15%20SOU
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE15%2520SOU%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for SE15%20SOU: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: AE18%20BLX
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AE18%2520BLX%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for AE18%20BLX: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: AJ64%20FXV
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AJ64%2520FXV%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for AJ64%20FXV: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: AK64%20ZHN
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK64%2520ZHN%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for AK64%20ZHN: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: AV09%20LXZ
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AV09%2520LXZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for AV09%20LXZ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BD16%20XCS
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD16%2520XCS%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BD16%20XCS: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BJ17%20OXU
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ17%2520OXU%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BJ17%20OXU: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BN13%20EFB
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BN13%2520EFB%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BN13%20EFB: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BT16%20URN
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT16%2520URN%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BT16%20URN: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BU56%20CVA
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BU56%2520CVA%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BU56%20CVA: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: DE05%20OOJ
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE05%2520OOJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for DE05%20OOJ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: DG15%20ZYY
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DG15%2520ZYY%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for DG15%20ZYY: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: DL68%20AZZ
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL68%2520AZZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for DL68%20AZZ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: DV65%20UZO
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DV65%2520UZO%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for DV65%20UZO: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: FE60%20ZPK
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE60%2520ZPK%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for FE60%20ZPK: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: FJ68%20LJK
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FJ68%2520LJK%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for FJ68%20LJK: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: FL10%20FUV
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL10%2520FUV%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for FL10%20FUV: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: FY13%20ZYC
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY13%2520ZYC%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for FY13%20ZYC: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: GX12%20LNV
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX12%2520LNV%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for GX12%20LNV: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: HG60%20HFE
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG60%2520HFE%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for HG60%20HFE: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: JM08%20ANT
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27JM08%2520ANT%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for JM08%20ANT: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: KA07%20UJL
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KA07%2520UJL%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for KA07%20UJL: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: KP65%20KVJ
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP65%2520KVJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for KP65%20KVJ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: KX63%20JUE
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KX63%2520JUE%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for KX63%20JUE: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: LM12%20KLS
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM12%2520KLS%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for LM12%20KLS: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: LM62%20KZC
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM62%2520KZC%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for LM62%20KZC: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: LV66%20VHJ
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LV66%2520VHJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for LV66%20VHJ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: LX62%20WEO
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LX62%2520WEO%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for LX62%20WEO: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: MD18%20JVV
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD18%2520JVV%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for MD18%20JVV: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: MK16%20HFG
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK16%2520HFG%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for MK16%20HFG: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: MT64%20YKC
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520YKC%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for MT64%20YKC: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: P22%20DCH
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27P22%2520DCH%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for P22%20DCH: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: S5%20WUT
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27S5%2520WUT%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for S5%20WUT: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: V12%20PEE
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V12%2520PEE%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for V12%20PEE: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: VN59%20KBK
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VN59%2520KBK%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for VN59%20KBK: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: WV18%20GNY
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WV18%2520GNY%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for WV18%20GNY: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: 99%20DVO
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%2799%2520DVO%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for 99%20DVO: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: AK17%20XMM
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK17%2520XMM%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for AK17%20XMM: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: AP65%20OYV
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AP65%2520OYV%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for AP65%20OYV: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BF18%20GYK
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF18%2520GYK%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BF18%20GYK: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BK16%20WHD
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK16%2520WHD%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BK16%20WHD: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BL19%20TPU
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BL19%2520TPU%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BL19%20TPU: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: BV65%20ZFO
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BV65%2520ZFO%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for BV65%20ZFO: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: CE66%20WTG
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE66%2520WTG%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for CE66%20WTG: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: CE67%20YXG
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE67%2520YXG%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for CE67%20YXG: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: EU17%20MLO
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EU17%2520MLO%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for EU17%20MLO: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: FE15%20LTF
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FE15%2520LTF%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for FE15%20LTF: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: FL63%20MVH
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL63%2520MVH%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for FL63%20MVH: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: GM65%20XJX
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GM65%2520XJX%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for GM65%20XJX: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: GP06%20PXR
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GP06%2520PXR%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for GP06%20PXR: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: GU61%20NNY
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GU61%2520NNY%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for GU61%20NNY: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: GX63%20BZJ
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:49 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GX63%2520BZJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:49 [bca.uk] INFO: Scrape type for GX63%20BZJ: 0
2026-03-28 11:12:49 [bca.uk] INFO: Found listing with ID: HN16%20OCZ
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HN16%2520OCZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for HN16%20OCZ: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: J800%20NEP
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27J800%2520NEP%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for J800%20NEP: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: LB67%20WHR
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LB67%2520WHR%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for LB67%20WHR: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: LC66%20PYB
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LC66%2520PYB%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for LC66%20PYB: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: LM13%20OUD
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM13%2520OUD%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for LM13%20OUD: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: LP65%20RYT
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LP65%2520RYT%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for LP65%20RYT: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: MK12%20MHN
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK12%2520MHN%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for MK12%20MHN: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: MK67%20LKU
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK67%2520LKU%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for MK67%20LKU: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: NA68%20MZO
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NA68%2520MZO%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for NA68%20MZO: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: ND14%20VOF
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND14%2520VOF%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for ND14%20VOF: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: NJ15%20TFX
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ15%2520TFX%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for NJ15%20TFX: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: NU62%20KHF
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NU62%2520KHF%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for NU62%20KHF: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: NV16%20VSX
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV16%2520VSX%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for NV16%20VSX: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: PX63%20SHZ
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PX63%2520SHZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for PX63%20SHZ: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: RY19%20XDA
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY19%2520XDA%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for RY19%20XDA: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SA68%20OUM
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SA68%2520OUM%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SA68%20OUM: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SC16%20NBG
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SC16%2520NBG%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SC16%20NBG: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SH12%20WTF
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH12%2520WTF%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SH12%20WTF: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SK17%20ORN
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK17%2520ORN%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SK17%20ORN: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SL16%20EZG
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL16%2520EZG%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SL16%20EZG: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SLZ%206923
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SLZ%25206923%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SLZ%206923: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: SN63%20EKC
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520EKC%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for SN63%20EKC: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: VO62%20RCX
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VO62%2520RCX%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for VO62%20RCX: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: WG66%20VEB
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WG66%2520VEB%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for WG66%20VEB: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: WO15%20WNR
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WO15%2520WNR%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for WO15%20WNR: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: YL68%20XHJ
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YL68%2520XHJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for YL68%20XHJ: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: AK67%20VJM
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK67%2520VJM%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for AK67%20VJM: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: AK68%20GNZ
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK68%2520GNZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for AK68%20GNZ: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: BF19%20FLA
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF19%2520FLA%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for BF19%20FLA: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: BK12%20XOF
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BK12%2520XOF%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for BK12%20XOF: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: CA19%20AVE
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA19%2520AVE%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for CA19%20AVE: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: CK18%20UHM
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK18%2520UHM%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for CK18%20UHM: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: CV64%20LKL
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CV64%2520LKL%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for CV64%20LKL: 0
2026-03-28 11:12:50 [bca.uk] INFO: Found listing with ID: DC66%20VXF
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:50 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DC66%2520VXF%27 HTTP/1.1" 200 None
2026-03-28 11:12:50 [bca.uk] INFO: Scrape type for DC66%20VXF: 0
2026-03-28 11:12:50 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:50 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:50 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:52 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=30&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:52 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:52 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded
2026-03-28 11:12:52 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:52 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: DE22%20VVP
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DE22%2520VVP%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for DE22%20VVP: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: DN67%20WOR
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DN67%2520WOR%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for DN67%20WOR: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: DU16%20UMJ
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DU16%2520UMJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for DU16%20UMJ: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: EA63%20YHO
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EA63%2520YHO%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for EA63%20YHO: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: EY15%20ZYF
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY15%2520ZYF%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for EY15%20ZYF: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: EY63%20XMS
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EY63%2520XMS%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for EY63%20XMS: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: FX17%20CHK
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FX17%2520CHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for FX17%20CHK: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: FY65%20VLD
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY65%2520VLD%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for FY65%20VLD: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: HK66%20JYB
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:52 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK66%2520JYB%27 HTTP/1.1" 200 None
2026-03-28 11:12:52 [bca.uk] INFO: Scrape type for HK66%20JYB: 0
2026-03-28 11:12:52 [bca.uk] INFO: Found listing with ID: KJ55%20VZW
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KJ55%2520VZW%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for KJ55%20VZW: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: KP23%20YGJ
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KP23%2520YGJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for KP23%20YGJ: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: LF62%20LBY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF62%2520LBY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for LF62%20LBY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: LS16%20HCY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS16%2520HCY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for LS16%20HCY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: LS17%20VHZ
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LS17%2520VHZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for LS17%20VHZ: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: MD15%20DZY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MD15%2520DZY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for MD15%20DZY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: MM18%20XBD
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520XBD%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for MM18%20XBD: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: MT64%20NDV
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT64%2520NDV%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for MT64%20NDV: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: MW17%20BYY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW17%2520BYY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for MW17%20BYY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: ND18%20DHC
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ND18%2520DHC%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for ND18%20DHC: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: NV19%20GTY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NV19%2520GTY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for NV19%20GTY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: PF64%20RWO
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PF64%2520RWO%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for PF64%20RWO: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: PG17%20JHL
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PG17%2520JHL%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for PG17%20JHL: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: PN17%20FCO
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN17%2520FCO%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for PN17%20FCO: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: RE64%20LXB
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE64%2520LXB%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for RE64%20LXB: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SB15%20HXA
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SB15%2520HXA%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SB15%20HXA: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SE18%20NNO
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SE18%2520NNO%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SE18%20NNO: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SG16%20JWY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG16%2520JWY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SG16%20JWY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SG62%20OUM
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SG62%2520OUM%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SG62%20OUM: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SH10%20KXB
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SH10%2520KXB%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SH10%20KXB: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SJ13%20CXF
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ13%2520CXF%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SJ13%20CXF: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SJ65%20GLG
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SJ65%2520GLG%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SJ65%20GLG: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SK18%20UPS
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK18%2520UPS%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SK18%20UPS: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SK66%20WEW
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK66%2520WEW%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SK66%20WEW: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SK67%20GUO
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520GUO%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SK67%20GUO: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SK67%20ZYU
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SK67%2520ZYU%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SK67%20ZYU: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SN63%20JSX
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SN63%2520JSX%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SN63%20JSX: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SR68%20LNY
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520LNY%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SR68%20LNY: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SR68%20PXX
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SR68%2520PXX%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SR68%20PXX: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SV65%20OLT
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SV65%2520OLT%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SV65%20OLT: 0
2026-03-28 11:12:53 [bca.uk] INFO: Found listing with ID: SW14%20ODA
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:53 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SW14%2520ODA%27 HTTP/1.1" 200 None
2026-03-28 11:12:53 [bca.uk] INFO: Scrape type for SW14%20ODA: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: SY19%20FEV
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SY19%2520FEV%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for SY19%20FEV: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: VK68%20ZZP
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27VK68%2520ZZP%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for VK68%20ZZP: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: WK60%20YPV
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WK60%2520YPV%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for WK60%20YPV: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: WP15%20UCM
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP15%2520UCM%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for WP15%20UCM: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: WR67%20AWU
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR67%2520AWU%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for WR67%20AWU: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: YD15%20TJX
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YD15%2520TJX%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for YD15%20TJX: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: YS09%20AEX
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS09%2520AEX%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for YS09%20AEX: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: YT11%20OGM
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT11%2520OGM%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for YT11%20OGM: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: YX63%20EZW
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YX63%2520EZW%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for YX63%20EZW: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: AO17%20WOX
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AO17%2520WOX%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for AO17%20WOX: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: BD64%20HBE
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520HBE%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for BD64%20HBE: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: BD64%20URO
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BD64%2520URO%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for BD64%20URO: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: BF61%20OBE
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BF61%2520OBE%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for BF61%20OBE: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: BJ65%20SPV
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BJ65%2520SPV%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for BJ65%20SPV: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: BT67%20LTA
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BT67%2520LTA%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for BT67%20LTA: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CA18%20OAB
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CA18%2520OAB%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CA18%20OAB: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CE15%20UHK
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CE15%2520UHK%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CE15%20UHK: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CK14%20AUL
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK14%2520AUL%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CK14%20AUL: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CK14%20UDV
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK14%2520UDV%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CK14%20UDV: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CK68%20VUY
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CK68%2520VUY%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CK68%20VUY: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CU16%20JCY
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CU16%2520JCY%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CU16%20JCY: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: CX61%20ZZS
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX61%2520ZZS%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for CX61%20ZZS: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: DF16%20KYR
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF16%2520KYR%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for DF16%20KYR: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: FL68%20WMX
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL68%2520WMX%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for FL68%20WMX: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: GL68%20EBP
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GL68%2520EBP%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for GL68%20EBP: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: GR54%20SEZ
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GR54%2520SEZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for GR54%20SEZ: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HG65%20FTZ
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HG65%2520FTZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HG65%20FTZ: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HJ13%20FDL
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ13%2520FDL%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HJ13%20FDL: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HJ67%20GXT
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HJ67%2520GXT%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HJ67%20GXT: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HK15%20WHB
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK15%2520WHB%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HK15%20WHB: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HK64%20KPR
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK64%2520KPR%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HK64%20KPR: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HS17%20PKX
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HS17%2520PKX%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HS17%20PKX: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: HW67%20GWK
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HW67%2520GWK%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for HW67%20GWK: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: KM06%20BYX
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM06%2520BYX%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for KM06%20BYX: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: LF18%20KBP
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LF18%2520KBP%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for LF18%20KBP: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: LJZ%203517
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LJZ%25203517%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for LJZ%203517: 0
2026-03-28 11:12:54 [bca.uk] INFO: Found listing with ID: LL17%20EKF
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:54 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL17%2520EKF%27 HTTP/1.1" 200 None
2026-03-28 11:12:54 [bca.uk] INFO: Scrape type for LL17%20EKF: 2
2026-03-28 11:12:54 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: b2327a32-b762-52ee-931f-07a3b23bb48f with identifier: LL17%20EKF
2026-03-28 11:12:54 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item b2327a32-b762-52ee-931f-07a3b23bb48f with scrape type 2
2026-03-28 11:12:54 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item b2327a32-b762-52ee-931f-07a3b23bb48f with scrape type 2
2026-03-28 11:12:55 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: b2327a32-b762-52ee-931f-07a3b23bb48f, identifier: LL17%20EKF
2026-03-28 11:12:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:55 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:55 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: b2327a32-b762-52ee-931f-07a3b23bb48f with identifier: LL17%20EKF
2026-03-28 11:12:55 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: b2327a32-b762-52ee-931f-07a3b23bb48f with identifier: LL17%20EKF
2026-03-28 11:12:55 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: b2327a32-b762-52ee-931f-07a3b23bb48f with expiration date: 2026-03-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 139,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=LL17%20EKF-GB',
'category': 'Car',
'color': 'black',
'currency': 'GBP',
'doors_number': 5,
'engine': '2.0L',
'expiration_date': '2026-03-28T10:00:00Z',
'fuel_type': 'Diesel',
'id': 'b2327a32-b762-52ee-931f-07a3b23bb48f',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'LL17 EKF',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=LL17%20EKF&vehicleType=*',
'listing': 'auction',
'location': 'Blackbushe',
'make': 'BMW',
'model': 'X5',
'odometer': 32929,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'BMW X5 2.0 SDRIVE 25D 231 SE StationWagon',
'transmission': 'manual',
'trim': 'SDRIVE 25D 231 SE',
'vin': 'WBAKT420100W35133',
'year': 2017}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LL17%2520EKF%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Saving data for LL17%20EKF: {'auction_closing_time': 1774692000.0, 'created_time': 1774609401.346843, 'last_price_update_time': 1774696375.030632}
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='LL17%2520EKF') HTTP/1.1" 204 0
2026-03-28 11:12:55 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: LM20%20YGP
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LM20%2520YGP%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for LM20%20YGP: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: LR18%20XPF
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LR18%2520XPF%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for LR18%20XPF: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: LT63%20TWG
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LT63%2520TWG%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for LT63%20TWG: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: LW66%20EFL
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LW66%2520EFL%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for LW66%20EFL: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: MF65%20JYD
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF65%2520JYD%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for MF65%20JYD: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: ML63%20FKH
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML63%2520FKH%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for ML63%20FKH: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: MV63%20EZU
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV63%2520EZU%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for MV63%20EZU: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: MV68%20YPF
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV68%2520YPF%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for MV68%20YPF: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: MW14%20EEM
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW14%2520EEM%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for MW14%20EEM: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: MW18%20ZMX
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MW18%2520ZMX%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for MW18%20ZMX: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: NX11%20YUG
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NX11%2520YUG%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for NX11%20YUG: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: OY10%20VCT
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OY10%2520VCT%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for OY10%20VCT: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: PJ66%20DPK
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PJ66%2520DPK%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for PJ66%20DPK: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: PK16%20BGU
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PK16%2520BGU%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for PK16%20BGU: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: PN14%20CYX
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PN14%2520CYX%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for PN14%20CYX: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: PY15%20TKA
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27PY15%2520TKA%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for PY15%20TKA: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: RJ17%20AXF
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ17%2520AXF%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for RJ17%20AXF: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: RY65%20SFZ
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RY65%2520SFZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for RY65%20SFZ: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: SD09%20XVM
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SD09%2520XVM%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for SD09%20XVM: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: SF13%20AVU
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF13%2520AVU%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for SF13%20AVU: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: SF16%20AVK
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF16%2520AVK%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for SF16%20AVK: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: SF66%20HMC
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SF66%2520HMC%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for SF66%20HMC: 0
2026-03-28 11:12:55 [bca.uk] INFO: Found listing with ID: SHZ%204847
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:55 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SHZ%25204847%27 HTTP/1.1" 200 None
2026-03-28 11:12:55 [bca.uk] INFO: Scrape type for SHZ%204847: 0
2026-03-28 11:12:57 [scrapy.core.engine] DEBUG: Crawled (200) <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=31&sort=MostRecentlyAdded> (referer: https://www.bca.co.uk/search) ['zyte-api']
2026-03-28 11:12:58 [bca.uk] INFO: Total items found: 100
2026-03-28 11:12:58 [bca.uk] INFO: Requesting URL: https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded
2026-03-28 11:12:58 [bca.uk] INFO: Sending search API request with Bearer token (length=1492)
2026-03-28 11:12:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: SL16%20HVZ
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27SL16%2520HVZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for SL16%20HVZ: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: ST62%20JYC
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ST62%2520JYC%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for ST62%20JYC: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: V20%20LSS
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27V20%2520LSS%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for V20%20LSS: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: WF54%20TVE
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF54%2520TVE%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for WF54%20TVE: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: WF61%20JZG
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF61%2520JZG%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for WF61%20JZG: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: WF62%20CCE
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WF62%2520CCE%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for WF62%20CCE: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: WR62%20TWZ
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WR62%2520TWZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for WR62%20TWZ: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: YE16%20BNZ
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE16%2520BNZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for YE16%20BNZ: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: YE64%20WBN
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YE64%2520WBN%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for YE64%20WBN: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: YF18%20YGH
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YF18%2520YGH%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for YF18%20YGH: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: YG18%20UUV
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YG18%2520UUV%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for YG18%20UUV: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: YH15%20YYU
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH15%2520YYU%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for YH15%20YYU: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: YS18%20VSK
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YS18%2520VSK%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for YS18%20VSK: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: AF64%20XUX
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AF64%2520XUX%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for AF64%20XUX: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: CRZ%202455
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CRZ%25202455%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for CRZ%202455: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: CX62%20XPL
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27CX62%2520XPL%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for CX62%20XPL: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: DA16%20DWL
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA16%2520DWL%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for DA16%20DWL: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: DA66%20CAO
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DA66%2520CAO%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for DA66%20CAO: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: DF18%20LDV
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DF18%2520LDV%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for DF18%20LDV: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: EF03%20CXR
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EF03%2520CXR%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for EF03%20CXR: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: EGZ%203015
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27EGZ%25203015%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for EGZ%203015: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: FL65%20UKO
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL65%2520UKO%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for FL65%20UKO: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: GF18%20UJV
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27GF18%2520UJV%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for GF18%20UJV: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: KE66%20WGJ
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KE66%2520WGJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for KE66%20WGJ: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: KR16%20CYS
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KR16%2520CYS%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for KR16%20CYS: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: KV09%20GYW
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV09%2520GYW%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for KV09%20GYW: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: KV68%20OJY
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KV68%2520OJY%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for KV68%20OJY: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: LK18%20UPR
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27LK18%2520UPR%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for LK18%20UPR: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: MA66%20FNM
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MA66%2520FNM%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for MA66%20FNM: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: MK16%20TMO
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MK16%2520TMO%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for MK16%20TMO: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: ML63%20OTR
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27ML63%2520OTR%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for ML63%20OTR: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: MM18%20FGP
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520FGP%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for MM18%20FGP: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: MM18%20VFV
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MM18%2520VFV%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for MM18%20VFV: 0
2026-03-28 11:12:58 [bca.uk] INFO: Found listing with ID: MT67%20DKK
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520DKK%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Scrape type for MT67%20DKK: 2
2026-03-28 11:12:58 [crawlers.middlewares.id_gen_middleware] INFO: Generated ID for item: 5497bb58-1c3d-50d1-98da-c5991a2058ef with identifier: MT67%20DKK
2026-03-28 11:12:58 [crawlers.middlewares.report_download_middleware] INFO: Skipping car_expert_report download for item 5497bb58-1c3d-50d1-98da-c5991a2058ef with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.photo_download_middleware] INFO: Skipping photo download for item 5497bb58-1c3d-50d1-98da-c5991a2058ef with scrape type 2
2026-03-28 11:12:58 [crawlers.middlewares.monitoring_spider_middleware] INFO: Spider: bca.uk, Processed item id: 5497bb58-1c3d-50d1-98da-c5991a2058ef, identifier: MT67%20DKK
2026-03-28 11:12:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:58 [scrapy_zyte_api._params] WARNING: Request <GET https://www.bca.co.uk/api/search?q=&pageSize=100&page=32&sort=MostRecentlyAdded> defines the Zyte API customHttpRequestHeaders parameter, overriding Request.headers. Use Request.headers instead.
2026-03-28 11:12:58 [crawlers.pipelines.translation_pipeline] INFO: Spider: bca.uk, Translating item: 5497bb58-1c3d-50d1-98da-c5991a2058ef with identifier: MT67%20DKK
2026-03-28 11:12:58 [crawlers.pipelines.item_rules_pipeline] INFO: Spider: bca.uk, Applying rules to item: 5497bb58-1c3d-50d1-98da-c5991a2058ef with identifier: MT67%20DKK
2026-03-28 11:12:58 [scrapy.core.scraper] INFO: Dropped: Dropping expired listing: 5497bb58-1c3d-50d1-98da-c5991a2058ef with expiration date: 2026-03-28T10:00:00Z
{'auction_title': '',
'c_o_2_emission_value': 120,
'car_expert_report_source_url': 'https://www1.bcaimage.com/Document?DocType=InspectionBase&Reg=MT67%20DKK-GB',
'category': 'Car',
'color': 'red',
'currency': 'GBP',
'doors_number': 3,
'engine': '1.4L',
'expiration_date': '2026-03-28T10:00:00Z',
'fuel_type': 'Petrol',
'id': '5497bb58-1c3d-50d1-98da-c5991a2058ef',
'is_damaged': False,
'is_operable': True,
'is_vat_deductible': False,
'is_vat_included': False,
'license_plate': 'MT67 DKK',
'link_to_web_offer': 'https://www.bca.co.uk/search?q=MT67%20DKK&vehicleType=*',
'listing': 'auction',
'location': 'Manchester',
'make': 'VAUXHALL',
'model': 'CORSA',
'odometer': 57282,
'odometer_reading_unit': 'mi',
'origin_country_code': 'GB',
'original_photo_count': 0,
'price': 0,
'price_includes_vat': False,
'registration_date': '2017-01-01',
'seller_name': None,
'title': 'VAUXHALL CORSA 1.4 75 LIMITED ED. Hatchback',
'transmission': 'manual',
'trim': '75 LIMITED ED.',
'vin': 'W0L0XEP08H6073852',
'year': 2017}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT67%2520DKK%27 HTTP/1.1" 200 None
2026-03-28 11:12:58 [bca.uk] INFO: Saving data for MT67%20DKK: {'auction_closing_time': 1774692000.0, 'created_time': 1774609413.849187, 'last_price_update_time': 1774696378.95939}
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:58 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "PATCH /ScrapedListings(PartitionKey='bca.uk',RowKey='MT67%2520DKK') HTTP/1.1" 204 0
2026-03-28 11:12:59 [zyte_api._retry] DEBUG: Starting call to 'zyte_api._async.AsyncZyteAPI.get.<locals>.request', this is the 1st time calling it.
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: NJ15%20YWH
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27NJ15%2520YWH%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for NJ15%20YWH: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: RJ18%20GPE
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RJ18%2520GPE%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for RJ18%20GPE: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: RV66%20AOP
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RV66%2520AOP%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for RV66%20AOP: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: WHZ%203609
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WHZ%25203609%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for WHZ%203609: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: YH19%20LVV
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YH19%2520LVV%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for YH19%20LVV: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: KM09%20ZGS
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27KM09%2520ZGS%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for KM09%20ZGS: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: OU70%20WKD
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27OU70%2520WKD%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for OU70%20WKD: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: DL10%20PKC
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27DL10%2520PKC%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for DL10%20PKC: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: YT62%20RBZ
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YT62%2520RBZ%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for YT62%20RBZ: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: WU07%20KYA
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WU07%2520KYA%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for WU07%20KYA: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: RE66%20UYD
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27RE66%2520UYD%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for RE66%20UYD: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: AK15%20LKG
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AK15%2520LKG%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for AK15%20LKG: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: FY64%20XWT
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FY64%2520XWT%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for FY64%20XWT: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: HK15%20LVR
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27HK15%2520LVR%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for HK15%20LVR: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: MF15%20WSJ
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MF15%2520WSJ%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for MF15%20WSJ: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: MT62%20WXL
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT62%2520WXL%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for MT62%20WXL: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: WP71%20XJC
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27WP71%2520XJC%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for WP71%20XJC: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: YO17%20AOM
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27YO17%2520AOM%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for YO17%20AOM: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: AX65%20GGY
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27AX65%2520GGY%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for AX65%20GGY: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: BG12%20YSV
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27BG12%2520YSV%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for BG12%20YSV: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: FL65%20VKN
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27FL65%2520VKN%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for FL65%20VKN: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: MT14%20RXF
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MT14%2520RXF%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for MT14%20RXF: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: MV15%20GGY
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "POST /Tables HTTP/1.1" 409 None
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "GET /ScrapedListings()?$filter=PartitionKey%20eq%20%27bca.uk%27%20and%20RowKey%20eq%20%27MV15%2520GGY%27 HTTP/1.1" 200 None
2026-03-28 11:12:59 [bca.uk] INFO: Scrape type for MV15%20GGY: 0
2026-03-28 11:12:59 [bca.uk] INFO: Found listing with ID: GY18%20NLO
2026-03-28 11:12:59 [urllib3.connectionpool] DEBUG: https://alxsourcingstorageprod.table.core.windows.net:443 "